Apr 28 04:45:52 devstack cinder-volume[72448]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 04:45:52 devstack cinder-volume[72448]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 04:45:52 devstack cinder-volume[72448]: we strongly recommend against using it for new projects. Apr 28 04:45:52 devstack cinder-volume[72448]: If you are already using Eventlet, we recommend migrating to a different Apr 28 04:45:52 devstack cinder-volume[72448]: framework. For more detail see Apr 28 04:45:52 devstack cinder-volume[72448]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 04:45:52 devstack cinder-volume[72448]: import eventlet # noqa Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:45:54 devstack cinder-volume[72448]: INFO dbcounter [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Registered counter for database cinder Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_db.sqlalchemy.engines [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG dbcounter [-] [72448] Writer thread running {{(pid=72448) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:45:54 devstack cinder-volume[72448]: INFO cinder.rpc [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 04:45:54 devstack cinder-volume[72448]: INFO cinder.rpc [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_db.sqlalchemy.engines [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:45:54 devstack cinder-volume[72448]: INFO cinder.volume.manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Determined volume DB was empty at startup. Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG cinder.volume.manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72448) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 04:45:54 devstack cinder-volume[72448]: INFO cinder.volume.manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 04:45:54 devstack cinder-volume[72448]: WARNING stevedore.named [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 04:45:54 devstack cinder-volume[72448]: WARNING castellan.key_manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:45:54 devstack cinder-volume[72448]: WARNING cinder.keymgr.conf_key_mgr [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG cinder.volume.drivers.lvm [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72448) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 28 04:45:54 devstack cinder-volume[72448]: DEBUG oslo_concurrency.processutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72448) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_concurrency.processutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] CMD "cinder-rtstool verify" returned: 0 in 0.249s {{(pid=72448) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_db.sqlalchemy.engines [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:45:55 devstack cinder-volume[72448]: INFO cinder.rpc [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 28 04:45:55 devstack cinder-volume[72448]: INFO cinder.rpc [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 28 04:45:55 devstack cinder-volume[72448]: WARNING stevedore.named [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 04:45:55 devstack cinder-volume[72448]: WARNING castellan.key_manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:45:55 devstack cinder-volume[72448]: INFO cinder.volume.manager [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_db.sqlalchemy.engines [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:45:55 devstack cinder-volume[72448]: INFO oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Starting 1 workers Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Started child 72555 {{(pid=72448) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Full set of CONF: {{(pid=72448) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] ******************************************************************************** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Configuration options gathered from: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] ================================================================================ {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 04:45:55 devstack cinder-volume[72555]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] allow_availability_zone_fallback = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] allow_compression_on_image_upload = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] allowed_direct_url_schemes = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] api_rate_limit = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] auth_strategy = keystone {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] az_cache_duration = 3600 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_availability_zone = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_host = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_stats_polling_interval = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backup_api_class = cinder.backup.api.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backup_name_template = backup-%s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backup_use_same_host = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backup_use_temp_snapshot = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] chap_password = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] chap_username = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_internal_tenant_project_id = 60c301c8f9224b31979c677223ef1f01 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_internal_tenant_user_id = fa9d5e03f0994c3688c5fc2b79b99ca4 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cloned_volume_same_az = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cluster = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] compression_format = gzip {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] compute_api_class = cinder.compute.nova.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] config_dir = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] config_source = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] control_exchange = openstack {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] debug = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] default_availability_zone = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] default_group_type = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] default_volume_type = lvmdriver-1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] disk_geometry = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_client_cert = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_client_cert_key = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_data_namespace = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_ssl_cert_path = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_ssl_cert_verify = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] driver_use_ssl = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] enable_force_upload = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] enable_new_services = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] enable_unsupported_driver = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] enabled_backends = ['lvmdriver-1'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] enforce_multipath_for_image_xfer = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] filter_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_api_insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_api_ssl_compression = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_ca_certificates_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_catalog_info = image:glance:publicURL {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_num_retries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance_request_timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72555]: INFO cinder.volume.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] goodness_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] graceful_shutdown_timeout = 5 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] group_api_class = cinder.group.api.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] host = devstack {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_compress_on_upload = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_conversion_address_space_limit = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_conversion_cpu_limit = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_conversion_disable = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_upload_use_cinder_backend = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_upload_use_internal_tenant = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_volume_cache_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_volume_cache_max_count = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] image_volume_cache_max_size_gb = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] init_host_max_objects_retrieval = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] instance_format = [instance: %(uuid)s] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iscsi_target_flags = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iscsi_write_cache = on {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iser_helper = tgtadm {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iser_ip_address = 192.168.122.146 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iser_port = 3260 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_color = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_config_append = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_dir = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_options = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_rotate_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_rotate_interval_type = days {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] log_rotation_type = none {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] max_age = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] max_logfile_count = 30 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] max_logfile_size_mb = 200 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] max_over_subscription_ratio = 20.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] message_reap_interval = 86400 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] message_ttl = 2592000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] migration_create_volume_timeout_secs = 300 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] monkey_patch = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] monkey_patch_modules = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] my_ip = 192.168.122.146 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] no_snapshot_gb_quota = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] num_iser_scan_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] num_shell_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] num_volume_device_scan_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] nvmeof_conn_info_version = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] nvmet_ns_id = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] nvmet_port_id = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_max_limit = 1000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_ext_list = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_listen = 0.0.0.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_listen_port = 8776 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_use_ssl = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] osapi_volume_workers = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] per_volume_size_limit = -1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] periodic_fuzzy_delay = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] periodic_interval = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] project_id_regex = [0-9a-f\-]+ {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] public_endpoint = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] publish_errors = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_backup_gigabytes = 1000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_backups = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_gigabytes = 1000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_groups = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_snapshots = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] quota_volumes = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] rate_limit_burst = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] rate_limit_except_level = CRITICAL {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] rate_limit_interval = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] reinit_driver_count = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] replication_device = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] report_discard_supported = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] report_interval = 120 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] reservation_clean_interval = 86400 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] reservation_expire = 86400 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] reserved_image_namespaces = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] reserved_percentage = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] rpc_response_timeout = 120 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] run_external_periodic_tasks = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] scst_target_driver = iscsi {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] scst_target_iqn_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_down_time = 720 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] shell_completion = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] snapshot_name_template = snapshot-%s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] snapshot_same_host = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] split_loggers = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] state_path = /opt/stack/data/cinder {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] storage_availability_zone = nova {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] storage_protocol = iSCSI {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] syslog_log_facility = LOG_USER {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_helper = lioadm {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_ip_address = 192.168.122.146 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_port = 3260 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_protocol = iscsi {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] target_secondary_ip_addresses = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] trace_flags = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] transfer_api_class = cinder.transfer.api.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] transport_url = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] until_refresh = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_chap_auth = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_default_quota_class = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_journal = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_json = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_multipath_for_image_xfer = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_stderr = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] use_syslog = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] verify_glance_signatures = enabled {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_api_class = cinder.volume.api.API {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_backend_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_clear = zero {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_clear_ionice = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_clear_size = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_copy_bps_limit = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_dd_blocksize = 1M {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_name_template = volume-%s {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_service_inithost_offload = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volume_usage_audit_period = month {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] zoning_mode = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_concurrency.disable_process_locking = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.admin_password = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.admin_token = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.admin_user = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_admin_prefix = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_port = 35357 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_protocol = https {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_section = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_type = password {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_uri = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.auth_version = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.cache = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.identity_uri = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.include_service_catalog = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.interface = public {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_password = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcache_username = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.region_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.service_token_roles_required = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.service_type = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.backend = dogpile.cache.null {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.backend_argument = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.backend_expiration_time = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.config_prefix = cache.oslo {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.debug_cache_backend = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.enable_retry_client = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.enable_socket_keepalive = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.enforce_fips_mode = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.expiration_time = 600 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.hashclient_retry_attempts = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_dead_retry = 300 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_pool_maxsize = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_sasl_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.password = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.proxies = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.redis_db = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.redis_server = localhost:6379 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.retry_attempts = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.retry_delay = 0.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.socket_keepalive_count = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.socket_keepalive_idle = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.socket_keepalive_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.socket_timeout = 1.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.tls_allowed_ciphers = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.tls_cafile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.tls_certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.tls_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.tls_keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cache.username = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] coordination.backend_url = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.asyncio_connection = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.asyncio_slave_connection = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.backend = sqlalchemy {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.connection = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.connection_debug = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.connection_parameters = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.connection_recycle_time = 3600 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.connection_trace = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.db_inc_retry_interval = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.db_max_retries = 20 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.db_max_retry_interval = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.db_retry_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.max_overflow = 50 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.max_pool_size = 5 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.max_retries = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.mysql_wsrep_sync_wait = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.pool_timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.retry_interval = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.slave_connection = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.sqlite_synchronous = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.synchronous_reader = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] database.use_db_reconnect = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.connection_string = messaging:// {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.es_doc_type = notification {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.es_scroll_size = 10000 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.es_scroll_time = 2m {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.filter_error_trace = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.hmac_keys = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.sentinel_service_name = mymaster {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.socket_timeout = 0.1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.trace_requests = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler.trace_sqlalchemy = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler_jaeger.process_tags = {} {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler_jaeger.service_name_prefix = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] profiler_otlp.service_name_prefix = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.enforce_new_defaults = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: WARNING oslo_config.cfg [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.enforce_scope = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.policy_default_rule = default {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.policy_file = policy.yaml {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_policy.remote_timeout = 60.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.group = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.helper_command = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] privsep_osbrick.user = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.group = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.helper_command = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] cinder_sys_admin.user = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.auth_section = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.auth_type = password {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.cafile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.collect_timing = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.send_service_user_token = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.split_loggers = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] service_user.timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.auth_section = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.auth_type = password {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.collect_timing = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.region_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.split_loggers = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] glance.timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.backend_availability_zone = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.chap_password = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.chap_username = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.disk_geometry = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_client_cert = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_client_cert_key = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_data_namespace = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.driver_use_ssl = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.extra_capabilities = {} {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.filter_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.goodness_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iscsi_target_flags = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iscsi_write_cache = on {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iser_helper = tgtadm {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iser_port = 3260 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.lvm_mirrors = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.lvm_share_target = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.lvm_type = auto {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.num_shell_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.replication_device = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.report_discard_supported = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.reserved_percentage = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_helper = tgtadm {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_port = 3260 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_protocol = iscsi {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.trace_flags = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.unique_fqdn_network = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack sudo[72559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 28 04:45:55 devstack sudo[72559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.use_chap_auth = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_backend_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_clear = zero {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_clear_ionice = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_clear_size = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volume_group = cinder-volumes {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_reports.file_event_handler = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_reports.log_dir = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.backend_availability_zone = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.backend_host = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.chap_password = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.chap_username = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.chiscsi_conf = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.disk_geometry = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_client_cert = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_data_namespace = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.driver_use_ssl = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.extra_capabilities = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.filter_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.goodness_function = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iser_helper = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iser_ip_address = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iser_port = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.iser_target_prefix = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.lvm_conf_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.lvm_mirrors = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.lvm_share_target = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.lvm_type = auto {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.num_shell_tries = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.nvmet_port_id = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.replication_device = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.report_discard_supported = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.reserved_percentage = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.scst_target_driver = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.storage_protocol = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_helper = lioadm {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_ip_address = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_port = 3260 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_protocol = iscsi {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.trace_flags = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.use_chap_auth = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_clear = zero {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_clear_size = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] lvmdriver-1.volumes_dir = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.ssl_version = {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_notifications.driver = [] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_notifications.retry = -1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] key_manager.fixed_key = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.barbican_api_version = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.barbican_endpoint = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.barbican_endpoint_type = public {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.barbican_region_name = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.cafile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.collect_timing = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.number_of_retries = 60 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.retry_delay = 1 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.send_service_user_token = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.split_loggers = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.verify_ssl = True {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican.verify_ssl_path = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.auth_section = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.auth_type = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.cafile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.certfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.collect_timing = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.insecure = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.keyfile = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.split_loggers = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] barbican_service_user.timeout = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.approle_role_id = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.approle_secret_id = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.kv_mountpoint = secret {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.kv_path = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.kv_version = 2 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.namespace = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.root_token_id = **** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.ssl_ca_crt_file = None {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.timeout = 60.0 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.use_ssl = False {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:45:55 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] ******************************************************************************** {{(pid=72448) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 04:45:56 devstack sudo[72559]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:56 devstack sudo[72616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:45:56 devstack sudo[72616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:56 devstack sudo[72616]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.543s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:45:56 devstack cinder-volume[72555]: INFO cinder.brick.local_dev.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:56 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:56 devstack sudo[72841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:45:56 devstack sudo[72841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:57 devstack sudo[72841]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:57 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:57 devstack cinder-volume[72555]: DEBUG cinder.brick.local_dev.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72555) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 28 04:45:57 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:57 devstack sudo[73043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:45:57 devstack sudo[73043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:58 devstack sudo[73043]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.093s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:58 devstack sudo[73212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:45:58 devstack sudo[73212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:58 devstack sudo[73212]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.534s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:58 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:58 devstack sudo[73252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 28 04:45:58 devstack sudo[73252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:59 devstack sudo[73252]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:59 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.452s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:59 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:59 devstack sudo[73256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:45:59 devstack sudo[73256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:45:59 devstack sudo[73256]: pam_unix(sudo:session): session closed for user root Apr 28 04:45:59 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:45:59 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:45:59 devstack sudo[73264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:45:59 devstack sudo[73264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:00 devstack sudo[73264]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:00 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:00 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:00 devstack sudo[73267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:00 devstack sudo[73267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:00 devstack sudo[73267]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:00 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:00 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:00 devstack sudo[73272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:00 devstack sudo[73272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:01 devstack sudo[73272]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:01 devstack sudo[73276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:01 devstack sudo[73276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:01 devstack sudo[73276]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:01 devstack cinder-volume[72555]: INFO cinder.volume.drivers.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:01 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:01 devstack sudo[73288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:01 devstack sudo[73288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:02 devstack sudo[73288]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:02 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:02 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:46:02 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:02 devstack sudo[73401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:46:02 devstack sudo[73401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:02 devstack sudo[73401]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:02 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:02 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:02 devstack sudo[73405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:02 devstack sudo[73405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:03 devstack sudo[73405]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:03 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:03 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:03 devstack sudo[73545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:03 devstack sudo[73545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:03 devstack sudo[73545]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:03 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:03 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:03 devstack sudo[73549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:03 devstack sudo[73549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:04 devstack sudo[73549]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:04 devstack cinder-volume[72555]: INFO cinder.volume.driver [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG cinder.volume.driver [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72555) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG oslo_db.sqlalchemy.engines [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72555) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG dbcounter [-] [72555] Writer thread running {{(pid=72555) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG cinder.db.sqlalchemy.api [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Building query based on filter {{(pid=72555) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG cinder.image.image_utils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72555) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 04:46:04 devstack cinder-volume[72555]: INFO cinder.keymgr.migration [None req-68b831ef-3906-4cf9-9228-1b7b69cc404d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:04 devstack sudo[73556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:46:04 devstack sudo[73556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:04 devstack sudo[73556]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:04 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:04 devstack sudo[73560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:04 devstack sudo[73560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:05 devstack cinder-volume[72448]: DEBUG dbcounter [-] [72448] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72448) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:46:05 devstack sudo[73560]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:05 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:05 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:05 devstack sudo[73564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:05 devstack sudo[73564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:05 devstack sudo[73564]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:05 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:05 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:05 devstack sudo[73569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:05 devstack sudo[73569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:06 devstack sudo[73569]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG cinder.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Notifying Schedulers of capabilities ... {{(pid=72555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:46:06 devstack cinder-volume[72555]: INFO cinder.volume.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Driver initialization completed successfully. Apr 28 04:46:06 devstack cinder-volume[72555]: INFO cinder.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Initiating service 2 cleanup Apr 28 04:46:06 devstack cinder-volume[72555]: INFO cinder.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Service 2 cleanup completed. Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG cinder.service [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Creating RPC server for service cinder-volume {{(pid=72555) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG cinder.service [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72555) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 04:46:06 devstack cinder-volume[72555]: INFO cinder.volume.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:46:06 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:06 devstack sudo[73575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:46:06 devstack sudo[73575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:07 devstack sudo[73575]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:07 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:07 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:07 devstack sudo[73579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:07 devstack sudo[73579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:07 devstack sudo[73579]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:07 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:07 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:07 devstack sudo[73582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:46:07 devstack sudo[73582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:08 devstack sudo[73582]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:08 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:08 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:46:08 devstack sudo[73673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:46:08 devstack sudo[73673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:46:08 devstack sudo[73673]: pam_unix(sudo:session): session closed for user root Apr 28 04:46:08 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:46:08 devstack cinder-volume[72555]: INFO cinder.volume.manager [None req-3077a959-8865-430f-9c54-e67a08538c50 None None] Driver post RPC initialization completed successfully. Apr 28 04:46:18 devstack cinder-volume[72555]: DEBUG dbcounter [-] [72555] Writing DB stats cinder:SELECT=4 {{(pid=72555) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:46:18 devstack cinder-volume[72555]: DEBUG dbcounter [-] [72555] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72555) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:47:10 devstack cinder-volume[72555]: DEBUG oslo_service.periodic_task [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72555) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:47:10 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:47:10 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:47:10 devstack sudo[78363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:47:10 devstack sudo[78363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:47:11 devstack sudo[78363]: pam_unix(sudo:session): session closed for user root Apr 28 04:47:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:47:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:47:11 devstack sudo[78368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:47:11 devstack sudo[78368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:47:11 devstack sudo[78368]: pam_unix(sudo:session): session closed for user root Apr 28 04:47:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:47:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:47:11 devstack sudo[78374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:47:11 devstack sudo[78374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:47:12 devstack sudo[78374]: pam_unix(sudo:session): session closed for user root Apr 28 04:47:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:47:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:47:12 devstack sudo[78377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:47:12 devstack sudo[78377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:47:12 devstack sudo[78377]: pam_unix(sudo:session): session closed for user root Apr 28 04:47:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:47:12 devstack cinder-volume[72555]: DEBUG cinder.manager [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Notifying Schedulers of capabilities ... {{(pid=72555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:48:10 devstack cinder-volume[72555]: DEBUG oslo_service.periodic_task [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72555) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:48:10 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:48:10 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:48:10 devstack sudo[78740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:48:10 devstack sudo[78740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:48:11 devstack sudo[78740]: pam_unix(sudo:session): session closed for user root Apr 28 04:48:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:48:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:48:11 devstack sudo[78842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:48:11 devstack sudo[78842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:48:11 devstack sudo[78842]: pam_unix(sudo:session): session closed for user root Apr 28 04:48:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:48:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:48:11 devstack sudo[79010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:48:11 devstack sudo[79010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:48:12 devstack sudo[79010]: pam_unix(sudo:session): session closed for user root Apr 28 04:48:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:48:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:48:12 devstack sudo[79014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:48:12 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:48:12 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root Apr 28 04:48:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:48:12 devstack cinder-volume[72555]: DEBUG cinder.manager [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Notifying Schedulers of capabilities ... {{(pid=72555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:48:18 devstack cinder-volume[72555]: DEBUG dbcounter [-] [72555] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72555) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:49:10 devstack cinder-volume[72555]: DEBUG oslo_service.periodic_task [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72555) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:49:10 devstack cinder-volume[72555]: DEBUG cinder.volume.drivers.lvm [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Updating volume stats {{(pid=72555) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 04:49:10 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:10 devstack sudo[80871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 04:49:10 devstack sudo[80871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:11 devstack sudo[80871]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:11 devstack sudo[80876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:49:11 devstack sudo[80876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:11 devstack sudo[80876]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:11 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:11 devstack sudo[80890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 04:49:11 devstack sudo[80890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:12 devstack sudo[80890]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:12 devstack sudo[80893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 04:49:12 devstack sudo[80893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:12 devstack sudo[80893]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:12 devstack cinder-volume[72555]: DEBUG oslo_concurrency.processutils [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72555) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:12 devstack cinder-volume[72555]: DEBUG cinder.manager [None req-9d84c897-f8ff-4eda-8521-6427b96acd35 None None] Notifying Schedulers of capabilities ... {{(pid=72555) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:49:38 devstack cinder-volume[72448]: INFO oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Caught SIGTERM, stopping children Apr 28 04:49:38 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Acquiring lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:38 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Acquired lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:38 devstack cinder-volume[72448]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Releasing lock "singleton_lock" {{(pid=72448) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:38 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Stop services. {{(pid=72448) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 04:49:38 devstack cinder-volume[72448]: DEBUG oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Killing children. {{(pid=72448) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 04:49:38 devstack cinder-volume[72448]: INFO oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Waiting on 1 children to exit Apr 28 04:49:41 devstack cinder-volume[72555]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Acquiring lock "singleton_lock" {{(pid=72555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:41 devstack cinder-volume[72555]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Acquired lock "singleton_lock" {{(pid=72555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:41 devstack cinder-volume[72555]: DEBUG oslo_concurrency.lockutils [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Releasing lock "singleton_lock" {{(pid=72555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:41 devstack cinder-volume[72555]: WARNING amqp [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 04:49:41 devstack cinder-volume[72555]: WARNING amqp [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 04:49:41 devstack cinder-volume[72448]: INFO oslo_service.backend._eventlet.service [None req-8263acd1-861f-4f21-8a07-d75b609c71dd None None] Child 72555 exited with status 0 Apr 28 04:49:41 devstack cinder-volume[81529]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 04:49:41 devstack cinder-volume[81529]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 04:49:41 devstack cinder-volume[81529]: we strongly recommend against using it for new projects. Apr 28 04:49:41 devstack cinder-volume[81529]: If you are already using Eventlet, we recommend migrating to a different Apr 28 04:49:41 devstack cinder-volume[81529]: framework. For more detail see Apr 28 04:49:41 devstack cinder-volume[81529]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 04:49:41 devstack cinder-volume[81529]: import eventlet # noqa Apr 28 04:49:43 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:43 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:43 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:44 devstack cinder-volume[81529]: INFO dbcounter [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Registered counter for database cinder Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_db.sqlalchemy.engines [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writer thread running {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:49:44 devstack cinder-volume[81529]: INFO cinder.rpc [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 04:49:44 devstack cinder-volume[81529]: INFO cinder.rpc [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_db.sqlalchemy.engines [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:44 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Determined volume DB was empty at startup. Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81529) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 04:49:44 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 04:49:44 devstack cinder-volume[81529]: WARNING stevedore.named [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 04:49:44 devstack cinder-volume[81529]: WARNING castellan.key_manager [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:49:44 devstack cinder-volume[81529]: WARNING cinder.keymgr.conf_key_mgr [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:49:44 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_db.sqlalchemy.engines [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:44 devstack cinder-volume[81529]: INFO oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Starting 1 workers Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Started child 81647 {{(pid=81529) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Full set of CONF: {{(pid=81529) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] ******************************************************************************** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Configuration options gathered from: {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] ================================================================================ {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] allow_availability_zone_fallback = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] allow_compression_on_image_upload = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] allowed_direct_url_schemes = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] api_rate_limit = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] auth_strategy = keystone {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81647]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_availability_zone = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_host = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_stats_polling_interval = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backup_api_class = cinder.backup.api.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backup_name_template = backup-%s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backup_use_same_host = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backup_use_temp_snapshot = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] chap_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] chap_username = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_internal_tenant_project_id = 60c301c8f9224b31979c677223ef1f01 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_internal_tenant_user_id = fa9d5e03f0994c3688c5fc2b79b99ca4 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cluster = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] compression_format = gzip {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] compute_api_class = cinder.compute.nova.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] config_dir = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] config_source = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] control_exchange = openstack {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] debug = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] default_availability_zone = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] default_group_type = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] default_volume_type = QuobyteHD {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] disk_geometry = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_client_cert = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_client_cert_key = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_data_namespace = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_ssl_cert_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_ssl_cert_verify = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] driver_use_ssl = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] enable_new_services = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] enable_unsupported_driver = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] enabled_backends = ['QuobyteHD'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] enforce_multipath_for_image_xfer = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] filter_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_api_insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_api_ssl_compression = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_ca_certificates_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_catalog_info = image:glance:publicURL {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_num_retries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance_request_timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] goodness_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] graceful_shutdown_timeout = 5 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] group_api_class = cinder.group.api.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] host = devstack {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_compress_on_upload = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_conversion_address_space_limit = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_conversion_cpu_limit = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_conversion_disable = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_upload_use_cinder_backend = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_upload_use_internal_tenant = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_volume_cache_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_volume_cache_max_count = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] image_volume_cache_max_size_gb = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] init_host_max_objects_retrieval = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] instance_format = [instance: %(uuid)s] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iscsi_target_flags = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iscsi_write_cache = on {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iser_helper = tgtadm {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iser_ip_address = 192.168.122.146 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iser_port = 3260 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_color = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_config_append = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_dir = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_options = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_rotate_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_rotate_interval_type = days {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] log_rotation_type = none {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] max_age = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] max_logfile_count = 30 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] max_logfile_size_mb = 200 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] max_over_subscription_ratio = 20.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] message_reap_interval = 86400 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] message_ttl = 2592000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] migration_create_volume_timeout_secs = 300 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] monkey_patch = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] monkey_patch_modules = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] my_ip = 192.168.122.146 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] no_snapshot_gb_quota = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] num_iser_scan_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] num_shell_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] num_volume_device_scan_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] nvmeof_conn_info_version = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] nvmet_ns_id = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81647]: INFO cinder.volume.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] nvmet_port_id = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.remotefs [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81647) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_max_limit = 1000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_ext_list = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_listen_port = 8776 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_use_ssl = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] osapi_volume_workers = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] per_volume_size_limit = -1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] periodic_fuzzy_delay = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] periodic_interval = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] public_endpoint = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] publish_errors = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_backup_gigabytes = 1000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_backups = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_gigabytes = 1000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_groups = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_snapshots = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] quota_volumes = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] rate_limit_burst = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] rate_limit_except_level = CRITICAL {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] rate_limit_interval = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] reinit_driver_count = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] replication_device = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] report_discard_supported = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] report_interval = 120 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] reservation_clean_interval = 86400 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] reservation_expire = 86400 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] reserved_image_namespaces = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] reserved_percentage = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] rpc_response_timeout = 120 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] run_external_periodic_tasks = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] scst_target_driver = iscsi {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] scst_target_iqn_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_down_time = 720 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] shell_completion = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] snapshot_name_template = snapshot-%s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] split_loggers = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] state_path = /opt/stack/data/cinder {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] storage_availability_zone = nova {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] storage_protocol = iSCSI {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] syslog_log_facility = LOG_USER {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_helper = lioadm {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_ip_address = 192.168.122.146 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_port = 3260 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_protocol = iscsi {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] target_secondary_ip_addresses = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] trace_flags = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] transport_url = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] until_refresh = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_chap_auth = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_default_quota_class = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_journal = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_json = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_multipath_for_image_xfer = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_stderr = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] use_syslog = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] verify_glance_signatures = enabled {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_api_class = cinder.volume.api.API {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_backend_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_clear = zero {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_clear_ionice = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_clear_size = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_copy_bps_limit = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_dd_blocksize = 1M {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_name_template = volume-%s {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_service_inithost_offload = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volume_usage_audit_period = month {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] zoning_mode = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_concurrency.disable_process_locking = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81647) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 04:49:44 devstack cinder-volume[81647]: WARNING cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 04:49:44 devstack cinder-volume[81647]: WARNING cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.admin_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Running cmd (subprocess): mount.quobyte {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.admin_token = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.admin_user = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_port = 35357 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_protocol = https {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_section = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_type = password {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_uri = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.auth_version = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.cache = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.identity_uri = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.include_service_catalog = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.interface = public {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_password = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcache_username = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.region_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.service_type = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.backend = dogpile.cache.null {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.backend_argument = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.backend_expiration_time = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:44 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.config_prefix = cache.oslo {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.debug_cache_backend = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.enable_retry_client = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.enable_socket_keepalive = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.enforce_fips_mode = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.expiration_time = 600 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.hashclient_retry_attempts = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_dead_retry = 300 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_pool_maxsize = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_sasl_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.proxies = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.redis_db = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.redis_server = localhost:6379 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.retry_attempts = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.retry_delay = 0.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.socket_keepalive_count = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.socket_keepalive_idle = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.socket_keepalive_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.socket_timeout = 1.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.tls_allowed_ciphers = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.tls_cafile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.tls_certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.tls_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.tls_keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cache.username = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] coordination.backend_url = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.asyncio_connection = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.asyncio_slave_connection = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.backend = sqlalchemy {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.connection = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.connection_debug = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.connection_parameters = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.connection_recycle_time = 3600 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.connection_trace = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.db_inc_retry_interval = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.db_max_retries = 20 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.db_max_retry_interval = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.db_retry_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.max_overflow = 50 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.max_pool_size = 5 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.max_retries = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.mysql_wsrep_sync_wait = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.pool_timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.retry_interval = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.slave_connection = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.sqlite_synchronous = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.synchronous_reader = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] database.use_db_reconnect = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack quobyte-client[81648]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 04:49:45 devstack quobyte-client[81648]: Invalid parameters found, error: missing mount point. Apr 28 04:49:45 devstack quobyte-client[81648]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 04:49:45 devstack quobyte-client[81648]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.connection_string = messaging:// {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.es_doc_type = notification {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.es_scroll_size = 10000 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.es_scroll_time = 2m {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.filter_error_trace = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.hmac_keys = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.sentinel_service_name = mymaster {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.socket_timeout = 0.1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.trace_requests = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler.trace_sqlalchemy = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler_jaeger.process_tags = {} {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler_jaeger.service_name_prefix = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] profiler_otlp.service_name_prefix = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.enforce_new_defaults = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:45 devstack cinder-volume[81529]: WARNING oslo_config.cfg [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.enforce_scope = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=81647) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.policy_default_rule = default {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81647]: INFO cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 ... Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de -c /etc/quobyte/client-cinder.cfg {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.policy_file = policy.yaml {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.group = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.helper_command = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] privsep_osbrick.user = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.group = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.helper_command = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] cinder_sys_admin.user = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.auth_section = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.auth_type = password {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.cafile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack sudo[81649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de -c /etc/quobyte/client-cinder.cfg Apr 28 04:49:45 devstack sudo[81649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.collect_timing = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.send_service_user_token = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.split_loggers = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] service_user.timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.auth_section = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.auth_type = password {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.collect_timing = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.region_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.split_loggers = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] glance.timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.backend_availability_zone = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.chap_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.chap_username = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.disk_geometry = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_client_cert = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_client_cert_key = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_data_namespace = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.driver_use_ssl = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.extra_capabilities = {} {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.filter_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.goodness_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iscsi_target_flags = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iscsi_write_cache = on {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iser_helper = tgtadm {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iser_port = 3260 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_host = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_login = admin {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_mount_options = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_private_key = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_share_path = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.num_shell_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.quobyte_volume_url = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.replication_device = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.report_discard_supported = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.reserved_percentage = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_helper = tgtadm {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_port = 3260 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_protocol = iscsi {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.trace_flags = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.unique_fqdn_network = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.use_chap_auth = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_backend_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_clear = zero {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_clear_ionice = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_clear_size = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_reports.file_event_handler = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_reports.log_dir = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.backend_availability_zone = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.backend_host = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.chap_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.chap_username = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.chiscsi_conf = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.disk_geometry = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_client_cert = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_data_namespace = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.driver_use_ssl = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.extra_capabilities = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.filter_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.goodness_function = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iser_helper = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iser_ip_address = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iser_port = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.iser_target_prefix = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_host = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_login = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_mount_options = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_password = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_private_key = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_share_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_ssh_port = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.num_shell_tries = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.nvmet_port_id = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.replication_device = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.report_discard_supported = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.reserved_percentage = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.scst_target_driver = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.storage_protocol = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_helper = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_ip_address = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_port = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_prefix = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_protocol = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.trace_flags = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.use_chap_auth = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_clear = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_clear_size = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] QuobyteHD.volumes_dir = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_notifications.driver = [] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_notifications.retry = -1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] key_manager.fixed_key = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.barbican_api_version = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.barbican_endpoint = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.barbican_endpoint_type = public {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.barbican_region_name = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.cafile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.collect_timing = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.number_of_retries = 60 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.retry_delay = 1 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.send_service_user_token = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.split_loggers = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.verify_ssl = True {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican.verify_ssl_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.auth_section = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.auth_type = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.cafile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.certfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.collect_timing = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.insecure = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.keyfile = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.split_loggers = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] barbican_service_user.timeout = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.approle_role_id = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.approle_secret_id = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.kv_mountpoint = secret {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.kv_path = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.kv_version = 2 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.namespace = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.root_token_id = **** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.ssl_ca_crt_file = None {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.timeout = 60.0 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.use_ssl = False {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:45 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] ******************************************************************************** {{(pid=81529) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 04:49:45 devstack sudo[81649]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.592s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:45 devstack cinder-volume[81647]: INFO cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 succeeded Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=81647) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.602s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:45 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:45 devstack sudo[81718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:45 devstack sudo[81718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:46 devstack sudo[81718]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.433s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.volume.driver [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Driver hasn't implemented _init_vendor_properties() Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.volume.driver [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81647) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_db.sqlalchemy.engines [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81647) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG dbcounter [-] [81647] Writer thread running {{(pid=81647) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.db.sqlalchemy.api [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Building query based on filter {{(pid=81647) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.image.image_utils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81647) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.keymgr.migration [None req-6b13363b-9ccc-4b8a-8c66-bafb9598a563 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=81647) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=81647) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:46 devstack sudo[81721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:46 devstack sudo[81721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:46 devstack sudo[81721]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.575s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Notifying Schedulers of capabilities ... {{(pid=81647) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.volume.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Driver initialization completed successfully. Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Initiating service 3 cleanup Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Service 3 cleanup completed. Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.service [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Creating RPC server for service cinder-volume {{(pid=81647) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.service [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81647) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 04:49:46 devstack cinder-volume[81647]: INFO cinder.volume.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=81647) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=81647) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:46 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:46 devstack sudo[81753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:46 devstack sudo[81753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:47 devstack sudo[81753]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:47 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.738s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:47 devstack cinder-volume[81647]: INFO cinder.volume.manager [None req-4da0bb98-1072-4888-82ab-96fef7fcbbdc None None] Driver post RPC initialization completed successfully. Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=81647) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG cinder.volume.drivers.quobyte [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=81647) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81647) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:49 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:49 devstack sudo[81837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:49 devstack sudo[81837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:50 devstack sudo[81837]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:50 devstack cinder-volume[81647]: DEBUG oslo_concurrency.processutils [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.405s {{(pid=81647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:50 devstack cinder-volume[81647]: DEBUG cinder.manager [None req-3eff6027-0f8d-4508-8fd4-f7f166866a9e None None] Notifying Schedulers of capabilities ... {{(pid=81647) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:49:53 devstack cinder-volume[81529]: INFO oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Caught SIGTERM, stopping children Apr 28 04:49:53 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Acquiring lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:53 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Acquired lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:53 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Releasing lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:53 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Stop services. {{(pid=81529) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 04:49:53 devstack cinder-volume[81529]: DEBUG oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Killing children. {{(pid=81529) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 04:49:53 devstack cinder-volume[81529]: INFO oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Waiting on 1 children to exit Apr 28 04:49:55 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Acquiring lock "singleton_lock" {{(pid=81647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:55 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Acquired lock "singleton_lock" {{(pid=81647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:55 devstack cinder-volume[81647]: DEBUG oslo_concurrency.lockutils [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Releasing lock "singleton_lock" {{(pid=81647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:55 devstack cinder-volume[81647]: WARNING amqp [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 04:49:55 devstack cinder-volume[81647]: WARNING amqp [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 04:49:55 devstack cinder-volume[81529]: INFO oslo_service.backend._eventlet.service [None req-bbd12ac0-6b1a-43f4-95dd-1a9d3fdc8397 None None] Child 81647 exited with status 0 Apr 28 04:49:55 devstack cinder-volume[81915]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 04:49:55 devstack cinder-volume[81915]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 04:49:55 devstack cinder-volume[81915]: we strongly recommend against using it for new projects. Apr 28 04:49:55 devstack cinder-volume[81915]: If you are already using Eventlet, we recommend migrating to a different Apr 28 04:49:55 devstack cinder-volume[81915]: framework. For more detail see Apr 28 04:49:55 devstack cinder-volume[81915]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 04:49:55 devstack cinder-volume[81915]: import eventlet # noqa Apr 28 04:49:57 devstack cinder-volume[81915]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81915) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 04:49:57 devstack cinder-volume[81915]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81915) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 04:49:57 devstack cinder-volume[81915]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81915) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 04:49:57 devstack cinder-volume[81915]: INFO dbcounter [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Registered counter for database cinder Apr 28 04:49:57 devstack cinder-volume[81915]: DEBUG oslo_db.sqlalchemy.engines [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG dbcounter [-] [81915] Writer thread running {{(pid=81915) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:49:58 devstack cinder-volume[81915]: INFO cinder.rpc [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 04:49:58 devstack cinder-volume[81915]: INFO cinder.rpc [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_db.sqlalchemy.engines [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:58 devstack cinder-volume[81915]: INFO cinder.volume.manager [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Determined volume DB was empty at startup. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG cinder.volume.manager [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81915) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 04:49:58 devstack cinder-volume[81915]: WARNING stevedore.named [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 04:49:58 devstack cinder-volume[81915]: WARNING castellan.key_manager [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:49:58 devstack cinder-volume[81915]: WARNING cinder.keymgr.conf_key_mgr [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 04:49:58 devstack cinder-volume[81915]: INFO cinder.volume.manager [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_db.sqlalchemy.engines [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:58 devstack cinder-volume[81915]: INFO oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Starting 1 workers Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Started child 82097 {{(pid=81915) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Full set of CONF: {{(pid=81915) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] ******************************************************************************** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Configuration options gathered from: {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] ================================================================================ {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] allow_availability_zone_fallback = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] allow_compression_on_image_upload = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] allowed_direct_url_schemes = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[82097]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] api_rate_limit = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] auth_strategy = keystone {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_availability_zone = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_host = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_stats_polling_interval = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backup_api_class = cinder.backup.api.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backup_name_template = backup-%s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backup_use_same_host = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backup_use_temp_snapshot = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] chap_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] chap_username = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_internal_tenant_project_id = 60c301c8f9224b31979c677223ef1f01 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_internal_tenant_user_id = fa9d5e03f0994c3688c5fc2b79b99ca4 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cluster = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] compression_format = gzip {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] compute_api_class = cinder.compute.nova.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] config_dir = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] config_source = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] control_exchange = openstack {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] debug = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] default_availability_zone = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] default_group_type = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] default_volume_type = QuobyteHD {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] disk_geometry = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_client_cert = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_client_cert_key = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_data_namespace = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_ssl_cert_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_ssl_cert_verify = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] driver_use_ssl = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] enable_new_services = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] enable_unsupported_driver = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] enabled_backends = ['QuobyteHD'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] enforce_multipath_for_image_xfer = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] filter_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_api_insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_api_ssl_compression = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_ca_certificates_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_catalog_info = image:glance:publicURL {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_num_retries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance_request_timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] goodness_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] graceful_shutdown_timeout = 5 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] group_api_class = cinder.group.api.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] host = devstack {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_compress_on_upload = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_conversion_address_space_limit = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_conversion_cpu_limit = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_conversion_disable = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_upload_use_cinder_backend = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_upload_use_internal_tenant = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_volume_cache_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_volume_cache_max_count = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] image_volume_cache_max_size_gb = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] init_host_max_objects_retrieval = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] instance_format = [instance: %(uuid)s] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iscsi_target_flags = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iscsi_write_cache = on {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iser_helper = tgtadm {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iser_ip_address = 192.168.122.146 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iser_port = 3260 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_color = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_config_append = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_dir = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 04:49:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82097) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_options = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_rotate_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_rotate_interval_type = days {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] log_rotation_type = none {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] max_age = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] max_logfile_count = 30 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] max_logfile_size_mb = 200 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] max_over_subscription_ratio = 20.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] message_reap_interval = 86400 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] message_ttl = 2592000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] migration_create_volume_timeout_secs = 300 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] monkey_patch = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] monkey_patch_modules = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] my_ip = 192.168.122.146 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] no_snapshot_gb_quota = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] num_iser_scan_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] num_shell_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] num_volume_device_scan_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] nvmeof_conn_info_version = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] nvmet_ns_id = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] nvmet_port_id = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_max_limit = 1000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_ext_list = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_listen_port = 8776 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_use_ssl = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] osapi_volume_workers = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] per_volume_size_limit = -1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] periodic_fuzzy_delay = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] periodic_interval = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] public_endpoint = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] publish_errors = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_backup_gigabytes = 1000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_backups = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_gigabytes = 1000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_groups = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_snapshots = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] quota_volumes = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] rate_limit_burst = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] rate_limit_except_level = CRITICAL {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] rate_limit_interval = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] reinit_driver_count = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] replication_device = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] report_discard_supported = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] report_interval = 120 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] reservation_clean_interval = 86400 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] reservation_expire = 86400 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] reserved_image_namespaces = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] reserved_percentage = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] rpc_response_timeout = 120 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] run_external_periodic_tasks = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] scst_target_driver = iscsi {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] scst_target_iqn_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_down_time = 720 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] shell_completion = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] snapshot_name_template = snapshot-%s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] split_loggers = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] state_path = /opt/stack/data/cinder {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] storage_availability_zone = nova {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] storage_protocol = iSCSI {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] syslog_log_facility = LOG_USER {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_helper = lioadm {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_ip_address = 192.168.122.146 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_port = 3260 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_protocol = iscsi {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] target_secondary_ip_addresses = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] trace_flags = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack quobyte-client[82127]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] transport_url = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] until_refresh = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_chap_auth = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_default_quota_class = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_journal = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_json = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack quobyte-client[82127]: Invalid parameters found, error: missing mount point. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_multipath_for_image_xfer = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_stderr = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] use_syslog = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] verify_glance_signatures = enabled {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_api_class = cinder.volume.api.API {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack quobyte-client[82127]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_backend_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_clear = zero {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_clear_ionice = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_clear_size = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_copy_bps_limit = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_dd_blocksize = 1M {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack quobyte-client[82127]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_name_template = volume-%s {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_service_inithost_offload = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volume_usage_audit_period = month {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] zoning_mode = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_concurrency.disable_process_locking = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.admin_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.admin_token = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.admin_user = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_port = 35357 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_protocol = https {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_section = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_type = password {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_uri = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.auth_version = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.cache = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.identity_uri = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.include_service_catalog = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.interface = public {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_password = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcache_username = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.region_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.service_type = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.backend = dogpile.cache.null {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.backend_argument = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.backend_expiration_time = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.config_prefix = cache.oslo {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.debug_cache_backend = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.enable_retry_client = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.enable_socket_keepalive = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.enforce_fips_mode = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82097) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.expiration_time = 600 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.hashclient_retry_attempts = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_dead_retry = 300 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_pool_maxsize = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_sasl_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.proxies = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.redis_db = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Running cmd (subprocess): mount.quobyte {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.redis_server = localhost:6379 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.retry_attempts = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.retry_delay = 0.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.socket_keepalive_count = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.socket_keepalive_idle = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.socket_keepalive_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.socket_timeout = 1.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.tls_allowed_ciphers = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.tls_cafile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.tls_certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.tls_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.tls_keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cache.username = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] coordination.backend_url = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.asyncio_connection = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.asyncio_slave_connection = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.backend = sqlalchemy {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.connection = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.connection_debug = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.connection_parameters = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.connection_recycle_time = 3600 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack sudo[82136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.connection_trace = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.db_inc_retry_interval = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.db_max_retries = 20 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.db_max_retry_interval = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.db_retry_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.max_overflow = 50 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.max_pool_size = 5 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack sudo[82136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.max_retries = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.mysql_wsrep_sync_wait = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.pool_timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.retry_interval = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.slave_connection = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.sqlite_synchronous = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.synchronous_reader = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] database.use_db_reconnect = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.connection_string = messaging:// {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.es_doc_type = notification {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.es_scroll_size = 10000 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.es_scroll_time = 2m {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.filter_error_trace = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.hmac_keys = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.sentinel_service_name = mymaster {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.socket_timeout = 0.1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.trace_requests = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler.trace_sqlalchemy = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler_jaeger.process_tags = {} {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler_jaeger.service_name_prefix = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] profiler_otlp.service_name_prefix = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.enforce_new_defaults = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: WARNING oslo_config.cfg [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.enforce_scope = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.policy_default_rule = default {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.policy_file = policy.yaml {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.group = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.helper_command = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] privsep_osbrick.user = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.group = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.helper_command = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] cinder_sys_admin.user = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.auth_section = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.auth_type = password {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.cafile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.collect_timing = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.send_service_user_token = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.split_loggers = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] service_user.timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.auth_section = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.auth_type = password {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.collect_timing = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.region_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.split_loggers = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] glance.timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.backend_availability_zone = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.chap_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.chap_username = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.disk_geometry = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_client_cert = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_client_cert_key = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_data_namespace = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.driver_use_ssl = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.extra_capabilities = {} {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.filter_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.goodness_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iscsi_target_flags = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iscsi_write_cache = on {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iser_helper = tgtadm {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iser_port = 3260 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_host = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_login = admin {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_mount_options = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_private_key = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_share_path = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.num_shell_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.quobyte_volume_url = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.replication_device = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.report_discard_supported = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.reserved_percentage = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_helper = tgtadm {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_port = 3260 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_protocol = iscsi {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.trace_flags = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.unique_fqdn_network = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.use_chap_auth = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_backend_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_clear = zero {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_clear_ionice = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_clear_size = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_reports.file_event_handler = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_reports.log_dir = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.backend_availability_zone = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.backend_host = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.chap_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.chap_username = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.chiscsi_conf = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.disk_geometry = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_client_cert = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_data_namespace = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.driver_use_ssl = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.extra_capabilities = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.filter_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.goodness_function = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] CMD "mount.quobyte" returned: 1 in 0.149s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iser_helper = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iser_ip_address = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iser_port = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.iser_target_prefix = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_host = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_login = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_mount_options = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_password = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_private_key = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_share_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_ssh_port = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.num_shell_tries = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.nvmet_port_id = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.replication_device = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.report_discard_supported = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.reserved_percentage = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.scst_target_driver = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.storage_protocol = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_helper = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_ip_address = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_port = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_prefix = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_protocol = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.trace_flags = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.use_chap_auth = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_clear = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_clear_size = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] QuobyteHD.volumes_dir = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_notifications.driver = [] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_notifications.retry = -1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] key_manager.fixed_key = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.barbican_api_version = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.barbican_endpoint = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.barbican_endpoint_type = public {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.barbican_region_name = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.cafile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.collect_timing = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.number_of_retries = 60 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.retry_delay = 1 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.send_service_user_token = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.split_loggers = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.verify_ssl = True {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican.verify_ssl_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.auth_section = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.auth_type = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.cafile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.certfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.collect_timing = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.insecure = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.keyfile = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.split_loggers = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] barbican_service_user.timeout = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.approle_role_id = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.approle_secret_id = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.kv_mountpoint = secret {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.kv_path = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.kv_version = 2 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.namespace = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.root_token_id = **** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.ssl_ca_crt_file = None {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.timeout = 60.0 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.use_ssl = False {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 04:49:59 devstack cinder-volume[81915]: DEBUG oslo_service.backend._eventlet.service [None req-767addd3-ad95-475f-aeb5-90a2a4673156 None None] ******************************************************************************** {{(pid=81915) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 04:49:59 devstack sudo[82136]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.532s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:59 devstack cinder-volume[82097]: INFO cinder.volume.driver [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.volume.driver [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82097) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_db.sqlalchemy.engines [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writer thread running {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.db.sqlalchemy.api [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Building query based on filter {{(pid=82097) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82097) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:49:59 devstack cinder-volume[82097]: INFO cinder.keymgr.migration [None req-d2433a6f-7a1a-457b-936a-00049f4e9abe None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 04:49:59 devstack sudo[82154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:49:59 devstack sudo[82154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:49:59 devstack sudo[82154]: pam_unix(sudo:session): session closed for user root Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.417s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:49:59 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:50:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Driver initialization completed successfully. Apr 28 04:50:00 devstack cinder-volume[82097]: INFO cinder.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Initiating service 3 cleanup Apr 28 04:50:00 devstack cinder-volume[82097]: INFO cinder.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Service 3 cleanup completed. Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG cinder.service [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Creating RPC server for service cinder-volume {{(pid=82097) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG cinder.service [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82097) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 04:50:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:50:00 devstack sudo[82160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:50:00 devstack sudo[82160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:50:00 devstack sudo[82160]: pam_unix(sudo:session): session closed for user root Apr 28 04:50:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.412s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:50:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8454bbe-ace6-44bc-9822-0858f275f7d4 None None] Driver post RPC initialization completed successfully. Apr 28 04:50:08 devstack cinder-volume[81915]: DEBUG dbcounter [-] [81915] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81915) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:50:10 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:50:10 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Flow 'volume_create_manager' (ddccf634-9d8a-4d23-95df-c2f5f46c90b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f272de42-8bbb-4a94-a2c2-c3a9ae6c4f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f272de42-8bbb-4a94-a2c2-c3a9ae6c4f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1602658101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6602106c-3e80-434b-b974-2d36899c8760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acadc3eb03864a65902243592653c965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:21Z,use_quota=True,user_id='8e0c13526d314302937abaf4beb8d7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705a4cfc-f9b7-4b64-9fbd-96eb35b38579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705a4cfc-f9b7-4b64-9fbd-96eb35b38579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d84f003-6718-4ab9-80c0-65e84984df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d84f003-6718-4ab9-80c0-65e84984df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6602106c-3e80-434b-b974-2d36899c8760', 'volume_name': 'volume-6602106c-3e80-434b-b974-2d36899c8760', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910d6f9-89bb-437e-875d-911bd9aa33e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910d6f9-89bb-437e-875d-911bd9aa33e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f16a4-a959-41a7-ba75-222ca9d144a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Volume 6602106c-3e80-434b-b974-2d36899c8760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6602106c-3e80-434b-b974-2d36899c8760', 'volume_size': 1} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1602658101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6602106c-3e80-434b-b974-2d36899c8760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acadc3eb03864a65902243592653c965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:21Z,use_quota=True,user_id='8e0c13526d314302937abaf4beb8d7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Creating volume 6602106c-3e80-434b-b974-2d36899c8760 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:51:21 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:51:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:21 devstack sudo[82716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 1073741824 Apr 28 04:51:21 devstack sudo[82716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Flow 'volume_create_manager' (05db454e-ba4c-4d1c-88a1-db0f7b8cac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7244a877-77d2-4c51-813a-38d4ea259cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7244a877-77d2-4c51-813a-38d4ea259cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-846502816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27ab526-4d61-4b11-93ac-940bbde3bc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd30774aa45842eb951d831da617ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:24Z,use_quota=True,user_id='9daf73dd78a543798f767882b7354d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4f152-c10e-48a1-ac78-162143ed9e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4f152-c10e-48a1-ac78-162143ed9e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc89d1a2-9a85-4dfe-b387-763ae11f7fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc89d1a2-9a85-4dfe-b387-763ae11f7fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27ab526-4d61-4b11-93ac-940bbde3bc6b', 'volume_name': 'volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26eed9f-2b82-4682-852c-2035ac83421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26eed9f-2b82-4682-852c-2035ac83421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b19972-e65d-49aa-adbb-99902b8ed116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Volume b27ab526-4d61-4b11-93ac-940bbde3bc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b', 'volume_size': 1} Apr 28 04:51:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:24 devstack sudo[82716]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 1073741824" returned: 0 in 2.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:24 devstack sudo[83039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 Apr 28 04:51:24 devstack sudo[83039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:25 devstack sudo[83039]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760" returned: 0 in 0.793s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] <== create_volume: return (3392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.404s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-846502816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27ab526-4d61-4b11-93ac-940bbde3bc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd30774aa45842eb951d831da617ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:24Z,use_quota=True,user_id='9daf73dd78a543798f767882b7354d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Creating volume b27ab526-4d61-4b11-93ac-940bbde3bc6b {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:51:25 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:25 devstack sudo[83042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b 1073741824 Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f16a4-a959-41a7-ba75-222ca9d144a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6602106c-3e80-434b-b974-2d36899c8760', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:25 devstack sudo[83042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d72ffd-ecc7-48f1-908e-50dde0dd3aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Volume volume-6602106c-3e80-434b-b974-2d36899c8760 (6602106c-3e80-434b-b974-2d36899c8760): created successfully Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d72ffd-ecc7-48f1-908e-50dde0dd3aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Flow 'volume_create_manager' (ddccf634-9d8a-4d23-95df-c2f5f46c90b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4c141721-0b39-4a06-b78e-41e509a529b0 tempest-DeleteServersTestJSON-1570396199 None] Created volume successfully. Apr 28 04:51:27 devstack sudo[83042]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b 1073741824" returned: 0 in 2.643s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:27 devstack sudo[83080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b Apr 28 04:51:27 devstack sudo[83080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:29 devstack sudo[83080]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b" returned: 0 in 1.700s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] <== create_volume: return (4430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.434s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b19972-e65d-49aa-adbb-99902b8ed116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c884fd-d20c-4000-bf6e-87a3559ceee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Volume volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b (b27ab526-4d61-4b11-93ac-940bbde3bc6b): created successfully Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c884fd-d20c-4000-bf6e-87a3559ceee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Flow 'volume_create_manager' (05db454e-ba4c-4d1c-88a1-db0f7b8cac65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e8d8291c-4d07-4e78-95de-1c44f21131c4 tempest-VolumesAdminNegativeTest-1521270580 None] Created volume successfully. Apr 28 04:51:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Acquiring lock "cinder-b27ab526-4d61-4b11-93ac-940bbde3bc6b-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:51:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "cinder-b27ab526-4d61-4b11-93ac-940bbde3bc6b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:51:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Acquiring lock "cinder-quobyte-b27ab526-4d61-4b11-93ac-940bbde3bc6b" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:51:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "cinder-quobyte-b27ab526-4d61-4b11-93ac-940bbde3bc6b" acquired by "delete_volume" :: waited 0.067s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:51:32 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp005vvjb2/privsep.sock'] Apr 28 04:51:32 devstack sudo[83180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp005vvjb2/privsep.sock Apr 28 04:51:32 devstack sudo[83180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 04:51:33 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 04:51:34 devstack cinder-volume[82097]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 28 04:51:35 devstack sudo[83180]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:35 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Spawned new privsep daemon via rootwrap Apr 28 04:51:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Accepted privsep connection to /tmp/tmp005vvjb2/privsep.sock {{(pid=82097) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 28 04:51:35 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 28 04:51:35 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 28 04:51:35 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 28 04:51:35 devstack cinder-volume[82097]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83188 Apr 28 04:51:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d845d-820c-4c5b-8758-b972b8efa06d]: (2,) {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:51:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca562b1-2d2f-4204-b837-d64c62eb3aea]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:51:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:35 devstack sudo[83192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b Apr 28 04:51:35 devstack sudo[83192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:36 devstack cinder-volume[82097]: WARNING py.warnings [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 28 04:51:36 devstack cinder-volume[82097]: .first() Apr 28 04:51:36 devstack cinder-volume[82097]: Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e760f8-af8e-4b42-84dd-78068e26ac45]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:36 devstack sudo[83203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 Apr 28 04:51:36 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:36 devstack sudo[83192]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b" returned: 0 in 0.886s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:36 devstack sudo[83208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b Apr 28 04:51:36 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:36 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760" returned: 0 in 0.707s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4', 'name': 'volume-6602106c-3e80-434b-b974-2d36899c8760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fda30499-c346-4548-9abb-85dd3226951c', 'enforce_multipath': True} {{(pid=82097) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 04:51:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-b0df69c8-55e1-4e4c-85e1-f096a65afc38 req-256bc748-a9ab-4c79-98df-8a1ede74d4bb tempest-DeleteServersTestJSON-1570396199 None] attachment_update completed successfully. Apr 28 04:51:37 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b27ab526-4d61-4b11-93ac-940bbde3bc6b" returned: 0 in 0.728s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "cinder-quobyte-b27ab526-4d61-4b11-93ac-940bbde3bc6b" released by "delete_volume" :: held 4.500s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:51:37 devstack cinder-volume[82097]: WARNING cinder.quota [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:51:37 devstack cinder-volume[82097]: WARNING cinder.quota [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Created reservations ['95f3e5e7-66d1-4f9d-bcc8-cd0146051528', 'a44e7b1e-8262-44a1-a3b0-fc4594c30232', '1ba28a7e-fcc4-4310-98e4-affdc0816a4f', '2bd28125-dc0c-4cea-8a49-8e4b37a299de'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:37 devstack sudo[83214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:51:37 devstack sudo[83214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:38 devstack sudo[83214]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.706s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:38 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:51:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Deleted volume successfully. Apr 28 04:51:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8f9e335c-21a4-4348-9653-cd22203d57c9 tempest-VolumesAdminNegativeTest-1521270580 None] Lock "cinder-b27ab526-4d61-4b11-93ac-940bbde3bc6b-delete_volume" released by "delete_volume" :: held 5.821s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=20,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=3 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Flow 'volume_create_manager' (71226d73-4bc2-4520-aecc-d30a84bcd40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a449ff-7919-44fc-9336-dd5dcb7dd5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a449ff-7919-44fc-9336-dd5dcb7dd5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:47Z,deleted=False,deleted_at=None,display_description='',display_name='e67645c8-3d0b-4604-b500-1b51a5fd706e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b1b8a-6f1d-44e1-bb06-587e2b73a609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d50d70c2bf4c50adaf4f07e54b770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:48Z,use_quota=True,user_id='b6b888d4a4544aa7998ed724ad69ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58717e92-ba38-4334-a6e8-27be9a4910b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58717e92-ba38-4334-a6e8-27be9a4910b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c6bf85-067c-4fd2-be80-7e25142a7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c6bf85-067c-4fd2-be80-7e25142a7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0b1b8a-6f1d-44e1-bb06-587e2b73a609', 'volume_name': 'volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc36dfbc-36aa-429d-8b46-5b3052868c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc36dfbc-36aa-429d-8b46-5b3052868c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce871c5e-bcbf-4634-8593-c3e4eaa64b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:47 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume 3e0b1b8a-6f1d-44e1-bb06-587e2b73a609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609', 'volume_size': 1} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:51:47Z,deleted=False,deleted_at=None,display_description='',display_name='e67645c8-3d0b-4604-b500-1b51a5fd706e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b1b8a-6f1d-44e1-bb06-587e2b73a609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d50d70c2bf4c50adaf4f07e54b770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:51:48Z,use_quota=True,user_id='b6b888d4a4544aa7998ed724ad69ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Creating volume 3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:51:47 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:47 devstack sudo[83759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 1073741824 Apr 28 04:51:47 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-56863d9d-789e-49e5-a082-931ef3e10a2c req-9ee1ea1c-f58e-4660-bcb5-632a83d8b4e5 tempest-DeleteServersTestJSON-1570396199 None] Terminate volume connection completed successfully. Apr 28 04:51:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-56863d9d-789e-49e5-a082-931ef3e10a2c req-9ee1ea1c-f58e-4660-bcb5-632a83d8b4e5 tempest-DeleteServersTestJSON-1570396199 None] Deleting attachment fda30499-c346-4548-9abb-85dd3226951c. {{(pid=82097) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 04:51:48 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 1073741824" returned: 0 in 0.853s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:48 devstack sudo[83769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 Apr 28 04:51:48 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:49 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" returned: 0 in 0.669s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce871c5e-bcbf-4634-8593-c3e4eaa64b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bfae49-4316-4af7-9b95-a0590ac597bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:51:49 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 (3e0b1b8a-6f1d-44e1-bb06-587e2b73a609): created successfully Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bfae49-4316-4af7-9b95-a0590ac597bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:51:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Flow 'volume_create_manager' (71226d73-4bc2-4520-aecc-d30a84bcd40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:51:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-09a16f80-3a9a-4a4e-bfd4-b426a11f8ca5 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Created volume successfully. Apr 28 04:51:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:51 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0321b400-d6a1-4c03-abb1-8f548b0089bc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:51:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:51 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 Apr 28 04:51:51 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:52 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" returned: 0 in 0.836s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4', 'name': 'volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab993471-0178-4137-b6a3-4e0db72d2dc0', 'enforce_multipath': True} {{(pid=82097) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 04:51:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-5467cccd-f33d-4c27-8bff-acf81661809f req-bf32fbb9-41b1-42a7-b825-06e24e9ce036 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] attachment_update completed successfully. Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "cinder-6602106c-3e80-434b-b974-2d36899c8760-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "cinder-6602106c-3e80-434b-b974-2d36899c8760-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "cinder-quobyte-6602106c-3e80-434b-b974-2d36899c8760" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "cinder-quobyte-6602106c-3e80-434b-b974-2d36899c8760" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f19fe7-0856-485d-9b1c-d08288a77e74]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:51:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:52 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 Apr 28 04:51:52 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:53 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760" returned: 0 in 1.048s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:53 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760 Apr 28 04:51:53 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:54 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6602106c-3e80-434b-b974-2d36899c8760" returned: 0 in 0.875s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "cinder-quobyte-6602106c-3e80-434b-b974-2d36899c8760" released by "delete_volume" :: held 2.006s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Created reservations ['f61d5499-c4cb-460b-8b2d-d693910673ad', 'ea9351b9-24fa-4a5d-b37b-27327be720d2', '8e3783eb-9148-4888-82cb-59cb0b40dc4d', '1286ffe3-51ed-42b2-a0c4-1ddec616b401'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:54 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:51:54 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:55 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.691s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:55 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:51:55 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Deleted volume successfully. Apr 28 04:51:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eaf9d595-d061-4cdf-8344-6a239823c605 tempest-DeleteServersTestJSON-1570396199 None] Lock "cinder-6602106c-3e80-434b-b974-2d36899c8760-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:51:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:51:56 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:51:56 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:51:57 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 28 04:51:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.251s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:51:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:05 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:52:10 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=34,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:52:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6115e2f5-0deb-454e-bc7e-632672a8633b tempest-GroupSnapshotsV319Test-1418652471 None] Group tempest-GroupSnapshotsV319Test-Group-1442153057: creating Apr 28 04:52:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6115e2f5-0deb-454e-bc7e-632672a8633b tempest-GroupSnapshotsV319Test-1418652471 None] Group tempest-GroupSnapshotsV319Test-Group-1442153057: created successfully Apr 28 04:52:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6115e2f5-0deb-454e-bc7e-632672a8633b tempest-GroupSnapshotsV319Test-1418652471 None] Create group completed successfully. Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Flow 'volume_create_manager' (ebb6bc87-d2ee-4d4e-a1de-22d70b410d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8431a079-ebba-4351-a878-381190dd1821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8431a079-ebba-4351-a878-381190dd1821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861496770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e25d4bbb-d652-4733-afbf-bdf4e753a647,host='devstack@QuobyteHD#QuobyteHD',id=a0068556-70fe-4fac-b04c-82c9884d5688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fd5866d3224e94af41a7c9b5bd55cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:17Z,use_quota=True,user_id='ad462e706c464afb8ec318de49fc2c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48beb4ce-1954-4238-b9e5-a19caaa3a570),volume_type_id=48beb4ce-1954-4238-b9e5-a19caaa3a570)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba1ef9b-db37-4a9b-b564-bc094560aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba1ef9b-db37-4a9b-b564-bc094560aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8522006-e8bb-4f21-9d2f-bee377fcb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8522006-e8bb-4f21-9d2f-bee377fcb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0068556-70fe-4fac-b04c-82c9884d5688', 'volume_name': 'volume-a0068556-70fe-4fac-b04c-82c9884d5688', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48ca4da-0c06-4c14-9e09-1499941040e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48ca4da-0c06-4c14-9e09-1499941040e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39f48e4-6bdb-4b60-8c1d-f0137d339990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Volume a0068556-70fe-4fac-b04c-82c9884d5688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0068556-70fe-4fac-b04c-82c9884d5688', 'volume_size': 1} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e25d4bbb-d652-4733-afbf-bdf4e753a647,created_at=2026-04-28T02:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861496770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e25d4bbb-d652-4733-afbf-bdf4e753a647,host='devstack@QuobyteHD#QuobyteHD',id=a0068556-70fe-4fac-b04c-82c9884d5688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fd5866d3224e94af41a7c9b5bd55cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:17Z,use_quota=True,user_id='ad462e706c464afb8ec318de49fc2c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48beb4ce-1954-4238-b9e5-a19caaa3a570),volume_type_id=48beb4ce-1954-4238-b9e5-a19caaa3a570)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Creating volume a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:52:16 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:52:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:16 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 1073741824 Apr 28 04:52:16 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:18 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 1073741824" returned: 0 in 1.235s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:18 devstack sudo[84639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 Apr 28 04:52:18 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Flow 'volume_create_manager' (a57487c3-9f29-4fc3-a28c-7e579ad5e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c324ec8f-6df5-42c9-9bec-8f836d6059e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c324ec8f-6df5-42c9-9bec-8f836d6059e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1609221305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478d038a-5bc3-4757-a89f-38148383a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae624a59c9f4fd7bb2601cf97d955aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:19Z,use_quota=True,user_id='15986dcd13fd4894aebe7c6707f30c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70bfc07-266f-41bb-9a89-0fff67de68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70bfc07-266f-41bb-9a89-0fff67de68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01603ec2-13b9-4344-93df-54ac86e7f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01603ec2-13b9-4344-93df-54ac86e7f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478d038a-5bc3-4757-a89f-38148383a374', 'volume_name': 'volume-478d038a-5bc3-4757-a89f-38148383a374', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9036a2-1cea-4537-a105-6dd71837daae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9036a2-1cea-4537-a105-6dd71837daae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d61aed-7cd1-448d-b4a1-0423c13e3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Volume 478d038a-5bc3-4757-a89f-38148383a374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478d038a-5bc3-4757-a89f-38148383a374', 'volume_size': 1} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:18 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688" returned: 0 in 0.738s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1609221305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478d038a-5bc3-4757-a89f-38148383a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae624a59c9f4fd7bb2601cf97d955aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:19Z,use_quota=True,user_id='15986dcd13fd4894aebe7c6707f30c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Creating volume 478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:52:18 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39f48e4-6bdb-4b60-8c1d-f0137d339990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0068556-70fe-4fac-b04c-82c9884d5688', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef0319f-f702-4a1e-8034-4c05a1950bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:18 devstack sudo[84643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 1073741824 Apr 28 04:52:18 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Volume volume-a0068556-70fe-4fac-b04c-82c9884d5688 (a0068556-70fe-4fac-b04c-82c9884d5688): created successfully Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef0319f-f702-4a1e-8034-4c05a1950bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Flow 'volume_create_manager' (ebb6bc87-d2ee-4d4e-a1de-22d70b410d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cc81de09-b2fd-4573-b85b-5d531208bccc tempest-GroupSnapshotsV319Test-1418652471 None] Created volume successfully. Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Flow 'volume_create_manager' (fb3963a4-ee39-48a6-9aab-dcd53e882900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16735311-5dab-43aa-9c76-383ebfab911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16735311-5dab-43aa-9c76-383ebfab911e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-361033578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8413e4-490c-4fab-9493-8a47105c97a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f171debb34c3e9d68d4c345ff926e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:19Z,use_quota=True,user_id='b7ecbb9c1b93485799cb5aca1acc7438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b469cf-ff82-4084-8fc4-83abf8b20f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b469cf-ff82-4084-8fc4-83abf8b20f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73028e3-8c0e-4df1-9ca7-0175547f77b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73028e3-8c0e-4df1-9ca7-0175547f77b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8413e4-490c-4fab-9493-8a47105c97a6', 'volume_name': 'volume-fd8413e4-490c-4fab-9493-8a47105c97a6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50098a39-e5cd-447d-b67c-ed53f1d34a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50098a39-e5cd-447d-b67c-ed53f1d34a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724ee865-6b43-4b2c-a414-cd38296fff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:19 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Volume fd8413e4-490c-4fab-9493-8a47105c97a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8413e4-490c-4fab-9493-8a47105c97a6', 'volume_size': 1} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] GroupSnapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: creating. Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Group snapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: creating. {{(pid=82097) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:19 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 1073741824" returned: 0 in 0.973s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:19 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 Apr 28 04:52:19 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:20 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374" returned: 0 in 0.507s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-361033578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8413e4-490c-4fab-9493-8a47105c97a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f171debb34c3e9d68d4c345ff926e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:19Z,use_quota=True,user_id='b7ecbb9c1b93485799cb5aca1acc7438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Creating volume fd8413e4-490c-4fab-9493-8a47105c97a6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:52:20 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d61aed-7cd1-448d-b4a1-0423c13e3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478d038a-5bc3-4757-a89f-38148383a374', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:20 devstack sudo[84656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 1073741824 Apr 28 04:52:20 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aaa94e-8f77-4549-bdf1-cec1b5a5dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Volume volume-478d038a-5bc3-4757-a89f-38148383a374 (478d038a-5bc3-4757-a89f-38148383a374): created successfully Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aaa94e-8f77-4549-bdf1-cec1b5a5dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Flow 'volume_create_manager' (a57487c3-9f29-4fc3-a28c-7e579ad5e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-bed7e218-e3ce-4269-bd5b-97286b1f5c36 req-61da08a2-2b85-4981-be5d-2ebe1882e0b6 tempest-VolumesSnapshotsTestJSON-1275667220 None] Created volume successfully. Apr 28 04:52:21 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 1073741824" returned: 0 in 0.666s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:21 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 Apr 28 04:52:21 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:21 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6" returned: 0 in 0.655s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.149s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724ee865-6b43-4b2c-a414-cd38296fff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8413e4-490c-4fab-9493-8a47105c97a6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50c645f-d334-48f6-959c-db58fcf07ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Creating offline snapshot d494a2fd-3897-482e-94a6-396017efcae0 of volume a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:52:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Volume volume-fd8413e4-490c-4fab-9493-8a47105c97a6 (fd8413e4-490c-4fab-9493-8a47105c97a6): created successfully Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50c645f-d334-48f6-959c-db58fcf07ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Flow 'volume_create_manager' (fb3963a4-ee39-48a6-9aab-dcd53e882900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfabdb1-88ec-4390-8dd3-84d10a773422]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-59190237-6282-4f53-a9fa-c9b09f8a3ca2 tempest-ServerRescueNegativeTestJSON-2049215152 None] Created volume successfully. Apr 28 04:52:21 devstack sudo[84675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 Apr 28 04:52:21 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:22 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688" returned: 0 in 0.549s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:22 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 1G Apr 28 04:52:22 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:23 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 1G" returned: 0 in 1.380s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0068556-70fe-4fac-b04c-82c9884d5688 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:23 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0068556-70fe-4fac-b04c-82c9884d5688 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 Apr 28 04:52:23 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:24 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0068556-70fe-4fac-b04c-82c9884d5688 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0" returned: 0 in 1.157s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:24 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:52:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:24 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 Apr 28 04:52:24 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:25 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:25 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info Apr 28 04:52:25 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:26 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info" returned: 0 in 0.648s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:26 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:26 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info Apr 28 04:52:26 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:26 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.info" returned: 0 in 0.602s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.079s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.357s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Creating offline snapshot 423524ff-f3fe-4d65-81ab-95454e8f3774 of volume 478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:52:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e41552-daa3-43ac-bb1a-bf0af2898164]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:27 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 Apr 28 04:52:27 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-24fd3d6d-570b-4081-94c8-1b0b4f41a811 tempest-GroupSnapshotsV319Test-1418652471 None] group_snapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: created successfully Apr 28 04:52:28 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374" returned: 0 in 1.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:28 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 1G Apr 28 04:52:28 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] group_snapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: deleting Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] group_snapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: deleting {{(pid=82097) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "cinder-quobyte-d494a2fd-3897-482e-94a6-396017efcae0" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-d494a2fd-3897-482e-94a6-396017efcae0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Deleting offline snapshot d494a2fd-3897-482e-94a6-396017efcae0 of volume a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] snapshot_file for this snap is: volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[57feb54e-edd1-42a1-bd4f-528593aa5685]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:29 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 Apr 28 04:52:29 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:29 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 1G" returned: 0 in 1.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478d038a-5bc3-4757-a89f-38148383a374 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:29 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478d038a-5bc3-4757-a89f-38148383a374 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 Apr 28 04:52:29 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:30 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0" returned: 0 in 1.424s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0068556-70fe-4fac-b04c-82c9884d5688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a475f121-3d3a-4d66-9d19-6a9242274486]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:30 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478d038a-5bc3-4757-a89f-38148383a374 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774" returned: 0 in 1.018s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:30 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 is being set with open permissions: ugo+rw Apr 28 04:52:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:30 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 Apr 28 04:52:30 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:31 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 Apr 28 04:52:31 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:31 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774" returned: 0 in 0.670s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:31 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688" returned: 0 in 0.795s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:31 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 Apr 28 04:52:31 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:31 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info Apr 28 04:52:31 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:32 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:32 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info is being set with open permissions: ugo+rw Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:32 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info Apr 28 04:52:32 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:32 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0" returned: 0 in 0.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:32 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0 Apr 28 04:52:32 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:32 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.info" returned: 0 in 0.593s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.904s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:32 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-6344fe2c-84d6-4206-8859-590821e224fb req-33e255be-ece0-4588-a4f9-7c295acf2c7d tempest-VolumesSnapshotsTestJSON-1275667220 None] Create snapshot completed successfully Apr 28 04:52:32 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688.d494a2fd-3897-482e-94a6-396017efcae0" returned: 0 in 0.703s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-d494a2fd-3897-482e-94a6-396017efcae0" released by "_delete_snapshot" :: held 3.669s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" released by "delete_snapshot" :: held 3.712s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:33 devstack cinder-volume[82097]: WARNING cinder.quota [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2074497051 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2074497051, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:52:33 devstack cinder-volume[82097]: WARNING cinder.quota [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2074497051 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2074497051, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] Created reservations ['53890171-6b4d-43ed-bb87-e4360952487c', 'a7914dbe-e5e9-4d0d-a5bb-35ec23a1216a', '2733a7a9-0371-4dda-9b6f-975fe64c597d', 'b672f3b1-6a90-47d8-860c-e6b6739be388'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0b16f976-a38d-42dd-9615-40ed2df3f804 tempest-GroupSnapshotsV319Test-1418652471 None] group_snapshot 8ac8c1ea-ee6e-49e5-acdc-becd645d4c03: deleted successfully Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "cinder-423524ff-f3fe-4d65-81ab-95454e8f3774-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-423524ff-f3fe-4d65-81ab-95454e8f3774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "cinder-quobyte-423524ff-f3fe-4d65-81ab-95454e8f3774" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-423524ff-f3fe-4d65-81ab-95454e8f3774" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Deleting offline snapshot 423524ff-f3fe-4d65-81ab-95454e8f3774 of volume 478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] snapshot_file for this snap is: volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ecfec-488d-47fc-a0aa-2eecfbe83b39]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:33 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 Apr 28 04:52:33 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1111a7db-045f-4446-aa32-3f922749634a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:34 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 Apr 28 04:52:34 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:34 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774" returned: 0 in 1.127s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-478d038a-5bc3-4757-a89f-38148383a374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6fa6f2-c59b-4762-9311-395a25c8bb11]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:34 devstack sudo[84967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 Apr 28 04:52:34 devstack sudo[84967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:35 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688" returned: 0 in 1.013s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:35 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688 Apr 28 04:52:35 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:35 devstack sudo[84967]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374" returned: 0 in 1.034s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:35 devstack sudo[85009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 Apr 28 04:52:35 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:36 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a0068556-70fe-4fac-b04c-82c9884d5688" returned: 0 in 1.067s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Lock "cinder-quobyte-a0068556-70fe-4fac-b04c-82c9884d5688" released by "delete_volume" :: held 2.199s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Created reservations ['9b8a6c44-b14f-4ebb-ba8f-f314689daf18'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:36 devstack cinder-volume[82097]: WARNING cinder.quota [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2074497051 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2074497051, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Created reservations ['18940fae-c649-455d-b53d-eafd820672dd', 'd476eb11-d5fe-451a-847b-7342d4517f39', '95178114-3318-4784-bc52-693913a12c06', 'd6096c86-67fc-4a65-9ff7-b370cb4fe79e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:36 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:52:36 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:36 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774" returned: 0 in 1.062s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:36 devstack sudo[85022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774 Apr 28 04:52:36 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:37 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.783s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d74da69f-9728-492f-8865-82471ecd852d tempest-GroupSnapshotsV319Test-1418652471 None] Delete group completed successfully. Apr 28 04:52:37 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374.423524ff-f3fe-4d65-81ab-95454e8f3774" returned: 0 in 0.895s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-423524ff-f3fe-4d65-81ab-95454e8f3774" released by "_delete_snapshot" :: held 4.280s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" released by "delete_snapshot" :: held 4.320s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:37 devstack cinder-volume[82097]: WARNING cinder.quota [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG cinder.quota [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Created reservations ['925c5703-ac99-48bf-bbf0-e58b2cbc86f7', 'd0c5704c-00f1-4e1d-be97-434c432ec822', '68815805-c8b0-47d0-a9a3-30d7ec50adf8', 'd6d7ae5c-805c-4851-9040-b8122ac69ed7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Delete snapshot completed successfully. Apr 28 04:52:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-cce4649d-667c-4376-bb0a-6d4995de7f65 req-289818c0-8802-4616-8f02-ce1f5e086feb tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-423524ff-f3fe-4d65-81ab-95454e8f3774-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "cinder-478d038a-5bc3-4757-a89f-38148383a374-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-478d038a-5bc3-4757-a89f-38148383a374-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" acquired by "delete_volume" :: waited 0.042s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b923e-bde5-418c-8548-f4fe55da0ff0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:38 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 Apr 28 04:52:38 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:39 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374" returned: 0 in 0.753s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:39 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374 Apr 28 04:52:39 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:40 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-478d038a-5bc3-4757-a89f-38148383a374" returned: 0 in 0.762s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-quobyte-478d038a-5bc3-4757-a89f-38148383a374" released by "delete_volume" :: held 1.631s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG cinder.quota [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Created reservations ['8cc708de-81dc-469d-a301-b436be82187f', '4dac002b-7dd7-470d-b92c-8762814e9183', 'face0ea8-f281-4c0b-bba6-747b8dc9bfc4', 'da894c22-6893-42d7-bee4-441930ee0447'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:40 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:52:40 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:41 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.141s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:41 devstack cinder-volume[82097]: DEBUG cinder.manager [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Deleted volume successfully. Apr 28 04:52:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-2e787798-cd3b-45ee-94d3-2ec0356e2a16 req-4bee9cff-91eb-4b17-965e-d4a6b96e7b36 tempest-VolumesSnapshotsTestJSON-1275667220 None] Lock "cinder-478d038a-5bc3-4757-a89f-38148383a374-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Acquiring lock "cinder-fd8413e4-490c-4fab-9493-8a47105c97a6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "cinder-fd8413e4-490c-4fab-9493-8a47105c97a6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Acquiring lock "cinder-quobyte-fd8413e4-490c-4fab-9493-8a47105c97a6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "cinder-quobyte-fd8413e4-490c-4fab-9493-8a47105c97a6" acquired by "delete_volume" :: waited 0.042s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7cfdc5-2cec-4f2f-9d70-11cb88630487]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:47 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 Apr 28 04:52:47 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:47 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6" returned: 0 in 0.717s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:47 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6 Apr 28 04:52:47 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Flow 'volume_create_manager' (0978af90-adb2-4f1e-bdc3-1a41bfc54f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f7e598-8837-406c-85fa-06eae702d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f7e598-8837-406c-85fa-06eae702d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1097602679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d45fff-807f-4351-b9f2-889a1484471c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff87a29b1dc64851a0b33fb9ae77c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:48Z,use_quota=True,user_id='10e9c0b637e14c9d982c557452238718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:48 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e28ad2-dcbf-4d03-847c-bdee7e4b492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e28ad2-dcbf-4d03-847c-bdee7e4b492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9dda7f-c4ab-4753-a20b-66c61cfaaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9dda7f-c4ab-4753-a20b-66c61cfaaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d45fff-807f-4351-b9f2-889a1484471c', 'volume_name': 'volume-33d45fff-807f-4351-b9f2-889a1484471c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2cfb3-f4c3-41c7-8b8d-80f5d79ddf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2cfb3-f4c3-41c7-8b8d-80f5d79ddf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef14c1a5-403f-4b46-bee8-2d6f6d7e7f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:48 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Volume 33d45fff-807f-4351-b9f2-889a1484471c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d45fff-807f-4351-b9f2-889a1484471c', 'volume_size': 1} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1097602679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d45fff-807f-4351-b9f2-889a1484471c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff87a29b1dc64851a0b33fb9ae77c81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:48Z,use_quota=True,user_id='10e9c0b637e14c9d982c557452238718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Creating volume 33d45fff-807f-4351-b9f2-889a1484471c {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:52:48 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fd8413e4-490c-4fab-9493-8a47105c97a6" returned: 0 in 0.877s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "cinder-quobyte-fd8413e4-490c-4fab-9493-8a47105c97a6" released by "delete_volume" :: held 1.694s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:48 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c 1073741824 Apr 28 04:52:48 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Created reservations ['1a17ef86-e124-4cea-8bd9-ecb0529801d7', '5d73b3a4-ca55-4c3b-bd86-84a30fc50f66', '6976c124-aac8-40ad-a8fa-0d24e480340d', '76155292-0011-411a-8b5a-5d350bc4c802'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:48 devstack sudo[85156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:52:48 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:49 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c 1073741824" returned: 0 in 0.835s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:49 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c Apr 28 04:52:49 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:49 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.844s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:49 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Deleted volume successfully. Apr 28 04:52:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bf2d0113-c750-4a12-8833-6cc8bad5ad9f tempest-ServerRescueNegativeTestJSON-2049215152 None] Lock "cinder-fd8413e4-490c-4fab-9493-8a47105c97a6-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:50 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c" returned: 0 in 0.835s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef14c1a5-403f-4b46-bee8-2d6f6d7e7f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d45fff-807f-4351-b9f2-889a1484471c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbbe414-23d3-4099-a7a8-9008b619f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:50 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Volume volume-33d45fff-807f-4351-b9f2-889a1484471c (33d45fff-807f-4351-b9f2-889a1484471c): created successfully Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbbe414-23d3-4099-a7a8-9008b619f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Flow 'volume_create_manager' (0978af90-adb2-4f1e-bdc3-1a41bfc54f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:50 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-2b395873-42bd-401c-adaa-7c1588575bd1 req-0a2376d9-e46c-40c4-aaaf-3591a679647a tempest-VolumesGetTestJSON-1691153667 None] Created volume successfully. Apr 28 04:52:51 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-be7ebd9d-1a8b-464f-be97-d806540c1e4b tempest-GroupsTest-962582551 None] Group tempest-Group1-1364917141: creating Apr 28 04:52:51 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-be7ebd9d-1a8b-464f-be97-d806540c1e4b tempest-GroupsTest-962582551 None] Group tempest-Group1-1364917141: created successfully Apr 28 04:52:51 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-be7ebd9d-1a8b-464f-be97-d806540c1e4b tempest-GroupsTest-962582551 None] Create group completed successfully. Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Acquiring lock "cinder-33d45fff-807f-4351-b9f2-889a1484471c-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "cinder-33d45fff-807f-4351-b9f2-889a1484471c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Acquiring lock "cinder-quobyte-33d45fff-807f-4351-b9f2-889a1484471c" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "cinder-quobyte-33d45fff-807f-4351-b9f2-889a1484471c" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb452d1a-b878-4f96-91ba-f47d7d2a9c62]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:51 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c Apr 28 04:52:51 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:52 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c" returned: 0 in 0.932s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-20f05ec2-8f18-4d1e-9538-b41e912a7b0b tempest-GroupsTest-962582551 None] Group tempest-Group2-1084288245: creating Apr 28 04:52:52 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c Apr 28 04:52:52 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-20f05ec2-8f18-4d1e-9538-b41e912a7b0b tempest-GroupsTest-962582551 None] Group tempest-Group2-1084288245: created successfully Apr 28 04:52:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-20f05ec2-8f18-4d1e-9538-b41e912a7b0b tempest-GroupsTest-962582551 None] Create group completed successfully. Apr 28 04:52:53 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-33d45fff-807f-4351-b9f2-889a1484471c" returned: 0 in 1.027s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "cinder-quobyte-33d45fff-807f-4351-b9f2-889a1484471c" released by "delete_volume" :: held 2.050s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG cinder.quota [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Created reservations ['01b997ec-5a61-43f4-8b4b-2df16e294cc2', '48f6e5e0-e07a-4542-a527-4ecfe4783869', '74400875-9fe6-4221-84d7-8179d610e719', 'b17123ab-e782-4146-b601-6d30910708ae'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:53 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:52:53 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (3eae03f0-1067-40dd-9f3b-f364ffa1e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d05037-e4d5-41ec-8d7f-e6ca16782099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d05037-e4d5-41ec-8d7f-e6ca16782099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495466859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d63fe5e2-5fa5-4cde-abcc-4e25df4d29a0,host='devstack@QuobyteHD#QuobyteHD',id=da240769-af4c-462f-9dd0-af36263a8def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:55Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e465eb84-fdaf-41f0-a826-ae4f23f31fc4),volume_type_id=e465eb84-fdaf-41f0-a826-ae4f23f31fc4)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118641ca-9e16-4909-aadd-c1228d2bcbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118641ca-9e16-4909-aadd-c1228d2bcbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f034c82-5443-4ff4-ab02-991acfa3fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f034c82-5443-4ff4-ab02-991acfa3fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da240769-af4c-462f-9dd0-af36263a8def', 'volume_name': 'volume-da240769-af4c-462f-9dd0-af36263a8def', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c913ac-171f-4595-885d-2b5d52b14a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c913ac-171f-4595-885d-2b5d52b14a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72fe711-6ca6-4dfd-8d5e-aa4d92fee4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:54 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Volume da240769-af4c-462f-9dd0-af36263a8def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da240769-af4c-462f-9dd0-af36263a8def', 'volume_size': 1} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d63fe5e2-5fa5-4cde-abcc-4e25df4d29a0,created_at=2026-04-28T02:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495466859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d63fe5e2-5fa5-4cde-abcc-4e25df4d29a0,host='devstack@QuobyteHD#QuobyteHD',id=da240769-af4c-462f-9dd0-af36263a8def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:52:55Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e465eb84-fdaf-41f0-a826-ae4f23f31fc4),volume_type_id=e465eb84-fdaf-41f0-a826-ae4f23f31fc4)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Creating volume da240769-af4c-462f-9dd0-af36263a8def {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:52:54 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:52:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:54 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def 1073741824 Apr 28 04:52:54 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:55 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.491s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:55 devstack cinder-volume[82097]: DEBUG cinder.manager [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:55 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Deleted volume successfully. Apr 28 04:52:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-a4a201e4-6a19-44ab-b0d0-1436bee179f3 req-c9b06a3c-54ad-415a-8d20-c1d93f7f670b tempest-VolumesGetTestJSON-1691153667 None] Lock "cinder-33d45fff-807f-4351-b9f2-889a1484471c-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:56 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def 1073741824" returned: 0 in 1.648s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:56 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:52:56 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:56 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def Apr 28 04:52:56 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:52:57 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def" returned: 0 in 1.199s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] <== create_volume: return (2923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.928s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72fe711-6ca6-4dfd-8d5e-aa4d92fee4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da240769-af4c-462f-9dd0-af36263a8def', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88811a5-90b9-44b7-bbe6-2511b5d68c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:52:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Volume volume-da240769-af4c-462f-9dd0-af36263a8def (da240769-af4c-462f-9dd0-af36263a8def): created successfully Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88811a5-90b9-44b7-bbe6-2511b5d68c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (3eae03f0-1067-40dd-9f3b-f364ffa1e183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:52:57 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.401s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:52:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:52:57 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f560c17c-8876-4b5c-862e-2a68135a6ee4 tempest-GroupsTest-962582551 None] Created volume successfully. Apr 28 04:52:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Acquiring lock "cinder-quobyte-da240769-af4c-462f-9dd0-af36263a8def" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:52:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-da240769-af4c-462f-9dd0-af36263a8def" acquired by "delete_volume" :: waited 0.039s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:52:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd97843e-cee8-41e3-8c83-4410ea10ca34]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:52:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:52:59 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def Apr 28 04:52:59 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:00 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def" returned: 0 in 1.290s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:00 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def Apr 28 04:53:00 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:01 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-da240769-af4c-462f-9dd0-af36263a8def" returned: 0 in 0.638s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-da240769-af4c-462f-9dd0-af36263a8def" released by "delete_volume" :: held 1.996s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Created reservations ['404c7342-a089-4466-9daf-7c23305927ff'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:01 devstack cinder-volume[82097]: WARNING cinder.quota [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-100394111 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-100394111, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:53:01 devstack cinder-volume[82097]: WARNING cinder.quota [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-100394111 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-100394111, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Created reservations ['b6351dc0-7977-41b3-a0ea-53c0b6ee87c9', '2fca7ac6-2272-41ca-bd71-e23e83506774', '7f358645-99ba-4a21-9082-338ed1ae25b8', 'cd176c9b-37d4-4ced-b275-8d412ccfa0b4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:02 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:02 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:02 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.944s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:02 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c878461a-fea3-411d-a9da-11a161565fe7 tempest-GroupsTest-962582551 None] Delete group completed successfully. Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Created reservations ['e6665432-3353-4d42-b701-9fc25f022440'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:03 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:03 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:04 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.752s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c65e23ec-0cd7-4c65-8a9e-a07da2254b4a tempest-GroupsTest-962582551 None] Delete group completed successfully. Apr 28 04:53:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aaabf70c-3415-4999-8dec-137c18ddce1e tempest-GroupsTest-962582551 None] Group tempest-GroupsTest-Group-428592234: creating Apr 28 04:53:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aaabf70c-3415-4999-8dec-137c18ddce1e tempest-GroupsTest-962582551 None] Group tempest-GroupsTest-Group-428592234: created successfully Apr 28 04:53:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aaabf70c-3415-4999-8dec-137c18ddce1e tempest-GroupsTest-962582551 None] Create group completed successfully. Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=80,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=4 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (a167f788-2f84-49ae-a212-8eb47a79156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5fb4b3-5a2f-44b0-82e7-5fac1c1a74fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5fb4b3-5a2f-44b0-82e7-5fac1c1a74fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1099618112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,host='devstack@QuobyteHD#QuobyteHD',id=c3ae5db7-c0db-4265-b65b-279ce64c64bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:07Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14efb6d9-65b8-4ab9-9e26-88bed446a8f7),volume_type_id=14efb6d9-65b8-4ab9-9e26-88bed446a8f7)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d6f743-90c3-42e6-b1f2-36c40ae6ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d6f743-90c3-42e6-b1f2-36c40ae6ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9c8062-84db-48c5-b978-f21c40ebc531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9c8062-84db-48c5-b978-f21c40ebc531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ae5db7-c0db-4265-b65b-279ce64c64bd', 'volume_name': 'volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc38f1f-af57-4937-8331-d9bd817ce790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc38f1f-af57-4937-8331-d9bd817ce790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538db725-61da-499e-a410-7e9760fb6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:06 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Volume c3ae5db7-c0db-4265-b65b-279ce64c64bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd', 'volume_size': 1} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,created_at=2026-04-28T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1099618112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,host='devstack@QuobyteHD#QuobyteHD',id=c3ae5db7-c0db-4265-b65b-279ce64c64bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:07Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14efb6d9-65b8-4ab9-9e26-88bed446a8f7),volume_type_id=14efb6d9-65b8-4ab9-9e26-88bed446a8f7)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Creating volume c3ae5db7-c0db-4265-b65b-279ce64c64bd {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:06 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:06 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd 1073741824 Apr 28 04:53:06 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:07 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd 1073741824" returned: 0 in 0.889s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:07 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd Apr 28 04:53:07 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:08 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd" returned: 0 in 0.510s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538db725-61da-499e-a410-7e9760fb6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5546c88-b672-4ec1-a5f4-e9e6ed0c20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:08 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Volume volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd (c3ae5db7-c0db-4265-b65b-279ce64c64bd): created successfully Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5546c88-b672-4ec1-a5f4-e9e6ed0c20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (a167f788-2f84-49ae-a212-8eb47a79156f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ec48863b-4f25-44be-9a9a-aa6d2cfad670 tempest-GroupsTest-962582551 None] Created volume successfully. Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (ef33848f-1ee5-400f-acc1-72d711bee850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfc6419-02ea-4f40-be35-71bb9125cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfc6419-02ea-4f40-be35-71bb9125cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011406349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,host='devstack@QuobyteHD#QuobyteHD',id=f9afc8d1-c448-415a-ac9b-4cc150fcbc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:10Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14efb6d9-65b8-4ab9-9e26-88bed446a8f7),volume_type_id=14efb6d9-65b8-4ab9-9e26-88bed446a8f7)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54664b2-002d-44a7-8d18-7cf96286ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54664b2-002d-44a7-8d18-7cf96286ff63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96abcc3-963d-45e3-9f8f-34c57851bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96abcc3-963d-45e3-9f8f-34c57851bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9afc8d1-c448-415a-ac9b-4cc150fcbc37', 'volume_name': 'volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25732aa5-246c-4fbd-a0e3-86bb45c43578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25732aa5-246c-4fbd-a0e3-86bb45c43578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43096724-c15b-4a85-bbe9-f4d2ed427769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:09 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Volume f9afc8d1-c448-415a-ac9b-4cc150fcbc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37', 'volume_size': 1} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,created_at=2026-04-28T02:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011406349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddc73318-d187-4062-b7c3-f1dccc1c4e6f,host='devstack@QuobyteHD#QuobyteHD',id=f9afc8d1-c448-415a-ac9b-4cc150fcbc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dcb6eddcbb4197a49c79667daf8872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:10Z,use_quota=True,user_id='ee0eea73033b43728ecb89012ffa0465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14efb6d9-65b8-4ab9-9e26-88bed446a8f7),volume_type_id=14efb6d9-65b8-4ab9-9e26-88bed446a8f7)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Creating volume f9afc8d1-c448-415a-ac9b-4cc150fcbc37 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:09 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:09 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 1073741824 Apr 28 04:53:09 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:10 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 1073741824" returned: 0 in 1.043s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:10 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=78,cinder:UPDATE=87,cinder:DELETE=6,cinder:INSERT=16 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:53:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:10 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 Apr 28 04:53:10 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:11 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" returned: 0 in 0.711s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43096724-c15b-4a85-bbe9-f4d2ed427769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55baa0bf-7276-4f2b-99d2-b120683ea3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:11 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Volume volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 (f9afc8d1-c448-415a-ac9b-4cc150fcbc37): created successfully Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55baa0bf-7276-4f2b-99d2-b120683ea3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Flow 'volume_create_manager' (ef33848f-1ee5-400f-acc1-72d711bee850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:11 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1f2ac760-11d7-4e1a-a41f-5f7ce0fe7f88 tempest-GroupsTest-962582551 None] Created volume successfully. Apr 28 04:53:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-77e2eb8e-2084-4532-ac19-ad44fc663f89 tempest-GroupsTest-962582551 None] Update group completed successfully. Apr 28 04:53:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1749ac19-2f57-4660-8e0d-1d856942d38e tempest-GroupsTest-962582551 None] Update group completed successfully. Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (3b927494-40f2-4691-93d3-f4967a817707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb508493-6c78-416c-9303-2a0a13ef3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb508493-6c78-416c-9303-2a0a13ef3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286222886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cefc9b-7126-48e0-9686-01d0fc62cc93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:15Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75241495-3a1d-495a-a270-30bec03c4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75241495-3a1d-495a-a270-30bec03c4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ebc7c7-0058-432e-83b6-0439605cc592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ebc7c7-0058-432e-83b6-0439605cc592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cefc9b-7126-48e0-9686-01d0fc62cc93', 'volume_name': 'volume-60cefc9b-7126-48e0-9686-01d0fc62cc93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ecb855-1177-4af2-87e2-5e579162709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ecb855-1177-4af2-87e2-5e579162709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061c466-a6c1-4196-a613-6e5992a12ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:14 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Volume 60cefc9b-7126-48e0-9686-01d0fc62cc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cefc9b-7126-48e0-9686-01d0fc62cc93', 'volume_size': 1} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286222886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cefc9b-7126-48e0-9686-01d0fc62cc93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:15Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Creating volume 60cefc9b-7126-48e0-9686-01d0fc62cc93 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:15 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:15 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 1073741824 Apr 28 04:53:15 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Acquiring lock "cinder-quobyte-c3ae5db7-c0db-4265-b65b-279ce64c64bd" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-c3ae5db7-c0db-4265-b65b-279ce64c64bd" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8fcad8-81d5-4875-adb8-2c868fe00dbe]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:15 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd Apr 28 04:53:15 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:15 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 1073741824" returned: 0 in 0.675s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:15 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 Apr 28 04:53:15 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:15 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd" returned: 0 in 0.724s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:15 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd Apr 28 04:53:15 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:16 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93" returned: 0 in 0.581s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061c466-a6c1-4196-a613-6e5992a12ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cefc9b-7126-48e0-9686-01d0fc62cc93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40e8dd7-b8b2-4ac8-86d5-31d301677093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Volume volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 (60cefc9b-7126-48e0-9686-01d0fc62cc93): created successfully Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40e8dd7-b8b2-4ac8-86d5-31d301677093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (3b927494-40f2-4691-93d3-f4967a817707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b9e083cd-8063-4383-942f-84e5d74b1bbb tempest-VolumesTestJSON-600194719 None] Created volume successfully. Apr 28 04:53:16 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c3ae5db7-c0db-4265-b65b-279ce64c64bd" returned: 0 in 0.729s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-c3ae5db7-c0db-4265-b65b-279ce64c64bd" released by "delete_volume" :: held 1.504s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Acquiring lock "cinder-quobyte-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" acquired by "delete_volume" :: waited 0.012s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d602ad-18a6-4424-8320-6f28d7ea07cf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:16 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 Apr 28 04:53:16 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:17 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" returned: 0 in 0.801s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:17 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37 Apr 28 04:53:17 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (9d4fe05b-8d24-466b-86b9-80b0f9b2c03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241ef38a-78df-4d0b-b297-4d186f5c73b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241ef38a-78df-4d0b-b297-4d186f5c73b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-754255109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc75e902-89c8-4978-9b3c-ec0a9fd159c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:18Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc611871-3c66-460d-8545-6b7dc7567593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc611871-3c66-460d-8545-6b7dc7567593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addc07e8-334f-4e9e-b6f0-b882e7f9c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addc07e8-334f-4e9e-b6f0-b882e7f9c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc75e902-89c8-4978-9b3c-ec0a9fd159c0', 'volume_name': 'volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf368b19-c99a-4129-9c08-b2d351fdfe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf368b19-c99a-4129-9c08-b2d351fdfe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f8095-3f95-4a28-b1b6-f03e7bc92a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:17 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Volume cc75e902-89c8-4978-9b3c-ec0a9fd159c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0', 'volume_size': 1} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-754255109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc75e902-89c8-4978-9b3c-ec0a9fd159c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:18Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Creating volume cc75e902-89c8-4978-9b3c-ec0a9fd159c0 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:17 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:17 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 1073741824 Apr 28 04:53:17 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:18 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" returned: 0 in 1.043s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "cinder-quobyte-f9afc8d1-c448-415a-ac9b-4cc150fcbc37" released by "delete_volume" :: held 1.903s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Flow 'volume_create_manager' (1aa3f9f6-89c0-487e-abf3-fb464f631de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3579e9-f839-4a3c-b168-528eb2f74e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3579e9-f839-4a3c-b168-528eb2f74e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2663840-3b08-4fd2-9fb6-ec86bd25ac1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d50d70c2bf4c50adaf4f07e54b770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:18Z,use_quota=True,user_id='b6b888d4a4544aa7998ed724ad69ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6bd8b-6a6a-412d-955f-eb9eda71d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6bd8b-6a6a-412d-955f-eb9eda71d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacb24b-2ea4-464c-b9a3-9f852cc0d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.image.glance [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Creating Keystone auth plugin from conf {{(pid=82097) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Created reservations ['2d02dac1-b339-4366-86fc-151d821b1dbf'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:18 devstack cinder-volume[82097]: WARNING cinder.quota [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1666913131 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1666913131, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:53:18 devstack cinder-volume[82097]: WARNING cinder.quota [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1666913131 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1666913131, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Created reservations ['c8476f3f-18d3-4a50-a00b-e1ec6033e40c', '83870843-4cc4-4ec6-9878-c81486c63012', '1d2bb60f-fc45-45ef-ba50-ee4e7393986b', 'b95533f0-7fe7-474e-89e5-fbdc905585f0'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:18 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 1073741824" returned: 0 in 1.095s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Created reservations ['0e19755c-7f9a-4c67-859b-b4f79041859e', 'effc5b57-e1a0-4680-82aa-1f63de8a6b2f', '9b3f6fb6-c729-41dd-bda8-dda66b5c8a25', 'b9b47043-4081-417c-84c4-a78e91d61406'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:19 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 Apr 28 04:53:19 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:19 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:19 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacb24b-2ea4-464c-b9a3-9f852cc0d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2663840-3b08-4fd2-9fb6-ec86bd25ac1a', 'volume_name': 'volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2def1f57-84fe-40ed-9e50-0c52bb1115d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2def1f57-84fe-40ed-9e50-0c52bb1115d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d40be-0a43-41f3-932f-d5314a61a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:19 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Trying to clone b2663840-3b08-4fd2-9fb6-ec86bd25ac1a from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]). {{(pid=82097) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 04:53:19 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" returned: 0 in 0.567s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f8095-3f95-4a28-b1b6-f03e7bc92a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16565228-9d18-445c-b4b3-5b0f0a4f6615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:19 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Volume volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 (cc75e902-89c8-4978-9b3c-ec0a9fd159c0): created successfully Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16565228-9d18-445c-b4b3-5b0f0a4f6615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (9d4fe05b-8d24-466b-86b9-80b0f9b2c03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-07483860-6e23-4e6d-ab3e-85e260b058db tempest-VolumesTestJSON-600194719 None] Created volume successfully. Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 04:53:19 devstack cinder-volume[82097]: INFO cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Image download 20.69 MB at 20.69 MB/s Apr 28 04:53:19 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.691s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a0811c48-95f1-4f6d-8602-c90e4f5e4606 tempest-GroupsTest-962582551 None] Delete group completed successfully. Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c4168-f24b-498f-b60c-366c1813fdca]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:19 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD Apr 28 04:53:19 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:20 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (33c41625-afe7-49e4-a539-9411d69ead5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09348f5e-5b43-4344-bccc-aa940f5e3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 is fetched for user b6b888d4a4544aa7998ed724ad69ccfc. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09348f5e-5b43-4344-bccc-aa940f5e3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621976845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cddeec-fe82-4acd-9338-ed65c5754949,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:21Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e35a8b4-2021-4539-b2c7-a2a9af442367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e35a8b4-2021-4539-b2c7-a2a9af442367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9ce367-9e76-4e14-9dbd-40e82d2b4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9ce367-9e76-4e14-9dbd-40e82d2b4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cddeec-fe82-4acd-9338-ed65c5754949', 'volume_name': 'volume-84cddeec-fe82-4acd-9338-ed65c5754949', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceda712-ac8d-4c1f-acfc-54534e8bb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceda712-ac8d-4c1f-acfc-54534e8bb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fd62ca-2797-49f4-8ccd-19aac1812ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Volume 84cddeec-fe82-4acd-9338-ed65c5754949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cddeec-fe82-4acd-9338-ed65c5754949', 'volume_size': 1} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621976845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cddeec-fe82-4acd-9338-ed65c5754949,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f050810fac4549b2bf04ad45567e7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:21Z,use_quota=True,user_id='3bdc2ef793ae42909aac5518a0ddb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Creating volume 84cddeec-fe82-4acd-9338-ed65c5754949 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:20 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:20 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 1073741824 Apr 28 04:53:20 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d29954-68a2-4000-84c3-8fe3a49df12b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:21 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD Apr 28 04:53:21 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:21 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 1073741824" returned: 0 in 0.874s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:21 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:21 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 Apr 28 04:53:21 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:22 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949" returned: 0 in 0.519s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2663840-3b08-4fd2-9fb6-ec86bd25ac1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d50d70c2bf4c50adaf4f07e54b770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:18Z,use_quota=True,user_id='b6b888d4a4544aa7998ed724ad69ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Creating volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:22 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:22 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1073741824 Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fd62ca-2797-49f4-8ccd-19aac1812ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cddeec-fe82-4acd-9338-ed65c5754949', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029f0152-9746-4ca1-ba24-f6a6296e5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Flow 'volume_create_manager' (9e398af0-113c-493c-9efb-692884e1b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da4185f-df12-4753-8587-67497de67fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da4185f-df12-4753-8587-67497de67fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-994961127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ea79de-5f13-4ac3-bc78-cc28fb54581f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba6cdb4e0a4af8b4debf5c58ded146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:22Z,use_quota=True,user_id='7d0b9c3a40074dabb71f25476525da32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78f6b8-eaa0-4951-9b68-ff7348727a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78f6b8-eaa0-4951-9b68-ff7348727a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59f7633-624e-48b9-829f-cbaf6d2175b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59f7633-624e-48b9-829f-cbaf6d2175b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ea79de-5f13-4ac3-bc78-cc28fb54581f', 'volume_name': 'volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4e48a4-1cea-4033-bfd1-07780c8078e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4e48a4-1cea-4033-bfd1-07780c8078e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef26ec1-a10a-413f-9efd-21bb3d1b745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:22 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Volume 76ea79de-5f13-4ac3-bc78-cc28fb54581f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f', 'volume_size': 1} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:22 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Volume volume-84cddeec-fe82-4acd-9338-ed65c5754949 (84cddeec-fe82-4acd-9338-ed65c5754949): created successfully Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029f0152-9746-4ca1-ba24-f6a6296e5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Flow 'volume_create_manager' (33c41625-afe7-49e4-a539-9411d69ead5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-83ed0f24-dca2-4c0b-a7e8-bf5a7a377f02 tempest-VolumesTestJSON-600194719 None] Created volume successfully. Apr 28 04:53:23 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1073741824" returned: 0 in 0.763s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:23 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:23 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:23 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 0.590s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-994961127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ea79de-5f13-4ac3-bc78-cc28fb54581f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba6cdb4e0a4af8b4debf5c58ded146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:22Z,use_quota=True,user_id='7d0b9c3a40074dabb71f25476525da32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Creating volume 76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:23 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:23 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f 1073741824 Apr 28 04:53:23 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Attempting download of 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3e46f-9584-40ce-9237-4e96ed019a68]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:23 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc Apr 28 04:53:23 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-84cddeec-fe82-4acd-9338-ed65c5754949-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "cinder-84cddeec-fe82-4acd-9338-ed65c5754949-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-quobyte-84cddeec-fe82-4acd-9338-ed65c5754949" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-84cddeec-fe82-4acd-9338-ed65c5754949" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51682c72-ca73-4a3a-b627-8ff8d64f474b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:24 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 Apr 28 04:53:24 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:24 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc" returned: 0 in 0.714s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:24 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f 1073741824" returned: 0 in 0.864s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:24 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f Apr 28 04:53:24 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:24 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc Apr 28 04:53:24 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:24 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949" returned: 0 in 0.692s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:24 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949 Apr 28 04:53:24 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:25 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc" returned: 1 in 0.644s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_de73pwoc' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd59571-2d8e-4861-a94d-eda10e80a9f7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:25 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef26ec1-a10a-413f-9efd-21bb3d1b745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22c22cc-510c-408b-ac97-afeaeb2156c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Volume volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f (76ea79de-5f13-4ac3-bc78-cc28fb54581f): created successfully Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22c22cc-510c-408b-ac97-afeaeb2156c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Flow 'volume_create_manager' (9e398af0-113c-493c-9efb-692884e1b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7636bba6-82d5-4144-a035-7ff5014a9522 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Created volume successfully. Apr 28 04:53:25 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD Apr 28 04:53:25 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:25 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-84cddeec-fe82-4acd-9338-ed65c5754949" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-84cddeec-fe82-4acd-9338-ed65c5754949" released by "delete_volume" :: held 1.276s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Created reservations ['edf6ad48-628b-42f8-8bc1-8f47dd9b3c41', '69796122-394f-49c7-a2da-7e8b610ef12d', '574e4b3a-3013-4aaa-812d-29c52cdf9a27', '801446eb-5030-4dba-91ae-6640b77e75f3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:25 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:25 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:25 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 was qcow2, converting to raw {{(pid=82097) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:25 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:25 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Creating offline snapshot 50580066-b8a6-4d37-ab04-2f1dbb0b4f1f of volume 76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbafc35-da7e-486e-8fc2-b37b6c5d1b6c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:25 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f Apr 28 04:53:25 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-193bda70-b757-4352-b465-b6e8026f4cce tempest-GroupsV320Test-1814067271 None] Group tempest-GroupsV320Test-Group-811600927: creating Apr 28 04:53:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-193bda70-b757-4352-b465-b6e8026f4cce tempest-GroupsV320Test-1814067271 None] Group tempest-GroupsV320Test-Group-811600927: created successfully Apr 28 04:53:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-193bda70-b757-4352-b465-b6e8026f4cce tempest-GroupsV320Test-1814067271 None] Create group completed successfully. Apr 28 04:53:26 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.633s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Deleted volume successfully. Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a7fb2f6-27e9-4ba2-aae4-63918f73cdf6 tempest-VolumesTestJSON-600194719 None] Lock "cinder-84cddeec-fe82-4acd-9338-ed65c5754949-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-cc75e902-89c8-4978-9b3c-ec0a9fd159c0-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "cinder-cc75e902-89c8-4978-9b3c-ec0a9fd159c0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-quobyte-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[79059abd-1b00-434b-86c9-c17551dedbbd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:26 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 Apr 28 04:53:26 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:26 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f" returned: 0 in 0.753s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:26 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f 1G Apr 28 04:53:26 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:27 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" returned: 0 in 0.637s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:27 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0 Apr 28 04:53:27 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:27 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 1.637s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_1c88yrppdevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:53:27 devstack cinder-volume[82097]: INFO cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Converted 112.00 MB image at 68.33 MB/s Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:27 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f 1G" returned: 0 in 0.822s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:27 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1G Apr 28 04:53:27 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:27 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f Apr 28 04:53:27 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Created reservations ['18d1e94b-720b-45f5-92f3-83694632ad78'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:27 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" returned: 0 in 0.583s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-cc75e902-89c8-4978-9b3c-ec0a9fd159c0" released by "delete_volume" :: held 1.290s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:27 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:27 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Created reservations ['0326c3ef-5fdd-49af-be50-8ba9b25ea4f1', '2c498f61-b98b-4ae2-a534-b01904e61708', 'c6794b57-f3b6-4d83-8e27-e8a551c03ca3', '2c75da2e-40d8-45f3-80e6-66c406d4d232'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:27 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:27 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:28 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a 1G" returned: 0 in 0.649s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c07b60f-cbdd-4231-8ee6-38a5063693eb]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:28 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" returned: 0 in 0.745s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f is being set with open permissions: ugo+rw Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:28 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:28 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:28 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f Apr 28 04:53:28 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:28 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-86887d53-c97a-4b56-9258-50dcb089e4c7 tempest-GroupsV320Test-1814067271 None] Delete group completed successfully. Apr 28 04:53:28 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.493s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Deleted volume successfully. Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-737b8dc7-8a44-4fe6-879e-caf06b7a09f8 tempest-VolumesTestJSON-600194719 None] Lock "cinder-cc75e902-89c8-4978-9b3c-ec0a9fd159c0-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-60cefc9b-7126-48e0-9686-01d0fc62cc93-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "cinder-60cefc9b-7126-48e0-9686-01d0fc62cc93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Acquiring lock "cinder-quobyte-60cefc9b-7126-48e0-9686-01d0fc62cc93" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:28 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" returned: 0 in 0.494s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 0.571s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-60cefc9b-7126-48e0-9686-01d0fc62cc93" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae8656-8f63-4833-9b1a-62fef1c0defa]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:28 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:28 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:28 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info Apr 28 04:53:28 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:28 devstack sudo[85643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 Apr 28 04:53:28 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:29 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:29 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info is being set with open permissions: ugo+rw Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:29 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info Apr 28 04:53:29 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:29 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93" returned: 0 in 0.696s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:29 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 1 in 0.744s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Downloaded image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a successfully. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 for user b6b888d4a4544aa7998ed724ad69ccfc is deleted. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Marking volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a as bootable. {{(pid=82097) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 04:53:29 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93 Apr 28 04:53:29 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Copying metadata from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 to b2663840-3b08-4fd2-9fb6-ec86bd25ac1a. {{(pid=82097) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Creating volume glance metadata for volume b2663840-3b08-4fd2-9fb6-ec86bd25ac1a backed by image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82097) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d40be-0a43-41f3-932f-d5314a61a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465ba23c-beaf-4ef3-9630-6f412af3f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Volume volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a (b2663840-3b08-4fd2-9fb6-ec86bd25ac1a): created successfully Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465ba23c-beaf-4ef3-9630-6f412af3f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Flow 'volume_create_manager' (1aa3f9f6-89c0-487e-abf3-fb464f631de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-ca54fcd7-4896-4dd9-bc93-89e390012e2b tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Created volume successfully. Apr 28 04:53:29 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.info" returned: 0 in 0.560s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.060s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-10840492-0f71-4022-968e-6b1d2e5b8751 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Create snapshot completed successfully Apr 28 04:53:29 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60cefc9b-7126-48e0-9686-01d0fc62cc93" returned: 0 in 0.557s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "cinder-quobyte-60cefc9b-7126-48e0-9686-01d0fc62cc93" released by "delete_volume" :: held 1.298s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Created reservations ['2dcf19dc-e990-4401-84b4-684123384f6c', '8e28957e-f7ee-4f49-9691-256938e8e5bc', '128bef2e-2ab4-4a89-9b2a-acbdd2faa6bb', 'fc670c42-f05c-4df0-9568-dc3e45fef2cd'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:30 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:30 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "cinder-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "cinder-quobyte-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Deleting offline snapshot 50580066-b8a6-4d37-ab04-2f1dbb0b4f1f of volume 76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] snapshot_file for this snap is: volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1effddd5-3bd9-4d38-8eea-6054310335a2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:30 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f Apr 28 04:53:30 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:30 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.622s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:30 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Deleted volume successfully. Apr 28 04:53:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-73dd0225-c25b-4320-8f12-ae2e96a0ecbb tempest-VolumesTestJSON-600194719 None] Lock "cinder-60cefc9b-7126-48e0-9686-01d0fc62cc93-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581c780-f8cd-48a8-9731-7adec7a42ce7]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:31 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:31 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:31 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" returned: 0 in 0.827s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09df4d8-0c42-43a2-b948-851f4baf6907]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:31 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f Apr 28 04:53:31 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:31 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 0.735s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:32 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:53:32 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:32 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f" returned: 0 in 0.966s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:32 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f Apr 28 04:53:32 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:32 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 1 in 0.772s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.548s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4', 'name': 'volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9899bdcc-789c-4dbe-8141-3f2143e7b151', 'enforce_multipath': True} {{(pid=82097) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 04:53:32 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-3951b3d8-22ed-416d-8438-5d7a82adf873 req-6d7a9cc9-8909-4204-a98a-af69dfb833de tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] attachment_update completed successfully. Apr 28 04:53:33 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" returned: 0 in 0.778s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:33 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f Apr 28 04:53:33 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:33 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f.50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f" released by "_delete_snapshot" :: held 3.269s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" released by "delete_snapshot" :: held 3.299s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:33 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Created reservations ['7e5a9299-0a4b-4ebb-9378-be524ef6430b', '7cd4c52c-a062-4a62-9c95-cdc0c1a4f6e9', '546bd850-0359-4e86-b108-2983c290a52b', '880886df-bc11-4e80-a7a1-2253f99cd9d4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Delete snapshot completed successfully. Apr 28 04:53:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32e05a87-059b-4346-a1df-c99265af11a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-50580066-b8a6-4d37-ab04-2f1dbb0b4f1f-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "cinder-76ea79de-5f13-4ac3-bc78-cc28fb54581f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-76ea79de-5f13-4ac3-bc78-cc28fb54581f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" acquired by "delete_volume" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d43be21-0a5b-4fea-b016-5b8a613d2859]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:35 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f Apr 28 04:53:35 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:35 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f" returned: 0 in 0.661s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:35 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f Apr 28 04:53:35 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:36 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-76ea79de-5f13-4ac3-bc78-cc28fb54581f" returned: 0 in 0.544s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-quobyte-76ea79de-5f13-4ac3-bc78-cc28fb54581f" released by "delete_volume" :: held 1.296s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Created reservations ['13165bcd-1cc2-48e8-bc05-a8318e60f41f', 'ad789e02-03b7-410e-a765-eaa0dc604a49', '6601f468-d374-478b-9e29-d8176e304dd4', '7063e1df-acfa-439c-9228-79505c022c27'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:36 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:36 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:37 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.465s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:37 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Deleted volume successfully. Apr 28 04:53:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df527ce0-779b-42c6-bbd3-6ddb688b98e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-36883115 None] Lock "cinder-76ea79de-5f13-4ac3-bc78-cc28fb54581f-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Flow 'volume_create_manager' (66361488-50b2-4322-aff5-718de2984714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7a5469-d284-4d18-9b9b-47d30fb4b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7a5469-d284-4d18-9b9b-47d30fb4b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-49018891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a550366f-aec7-4511-ab58-4e11232ec2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cc888e9302455ba22d23dbfe0ec606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:42Z,use_quota=True,user_id='f4ce35130c5e4efcb0d7a6220ca6bf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ca0f67-beef-44dd-bec8-f77990f1e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ca0f67-beef-44dd-bec8-f77990f1e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f5eb66-96aa-487d-9b02-43585f717d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f5eb66-96aa-487d-9b02-43585f717d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a550366f-aec7-4511-ab58-4e11232ec2a7', 'volume_name': 'volume-a550366f-aec7-4511-ab58-4e11232ec2a7', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f1a19-2fd2-4312-a1be-8ff9ae97d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f1a19-2fd2-4312-a1be-8ff9ae97d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c85f8a-683e-44ce-a470-68701b593cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:42 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Volume a550366f-aec7-4511-ab58-4e11232ec2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a550366f-aec7-4511-ab58-4e11232ec2a7', 'volume_size': 1} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-49018891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a550366f-aec7-4511-ab58-4e11232ec2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cc888e9302455ba22d23dbfe0ec606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:42Z,use_quota=True,user_id='f4ce35130c5e4efcb0d7a6220ca6bf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Creating volume a550366f-aec7-4511-ab58-4e11232ec2a7 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:42 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:42 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 1073741824 Apr 28 04:53:42 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:43 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 1073741824" returned: 0 in 1.058s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:43 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 Apr 28 04:53:43 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:44 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7" returned: 0 in 0.838s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c85f8a-683e-44ce-a470-68701b593cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a550366f-aec7-4511-ab58-4e11232ec2a7', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d9cc6-49fc-44a5-a350-95044840f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:44 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Volume volume-a550366f-aec7-4511-ab58-4e11232ec2a7 (a550366f-aec7-4511-ab58-4e11232ec2a7): created successfully Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d9cc6-49fc-44a5-a350-95044840f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Flow 'volume_create_manager' (66361488-50b2-4322-aff5-718de2984714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:44 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2a342f79-c75c-4096-9ccb-daaf6d070b7a tempest-VolumeQuotasNegativeTestJSON-131599187 None] Created volume successfully. Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Acquiring lock "cinder-a550366f-aec7-4511-ab58-4e11232ec2a7-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "cinder-a550366f-aec7-4511-ab58-4e11232ec2a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Acquiring lock "cinder-quobyte-a550366f-aec7-4511-ab58-4e11232ec2a7" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "cinder-quobyte-a550366f-aec7-4511-ab58-4e11232ec2a7" acquired by "delete_volume" :: waited 0.044s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74acc570-d1eb-4a26-b4d5-1a3137052f05]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:53:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:46 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 Apr 28 04:53:46 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:47 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7" returned: 0 in 0.853s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:47 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7 Apr 28 04:53:47 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:47 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a550366f-aec7-4511-ab58-4e11232ec2a7" returned: 0 in 0.633s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "cinder-quobyte-a550366f-aec7-4511-ab58-4e11232ec2a7" released by "delete_volume" :: held 1.584s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Created reservations ['5daa13ab-00f6-4d3c-839f-d26ad0f0b814', '91777a3a-5520-4754-a8fd-c80c47cd40cd', '1102778c-c09b-47bf-a4b9-f3de125b2ab3', 'cd511934-3883-45d1-9ac1-2a6476f17d56'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:48 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:48 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:48 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.830s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Deleted volume successfully. Apr 28 04:53:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cfcc4e5-712d-4054-8b87-88d5950e290f tempest-VolumeQuotasNegativeTestJSON-131599187 None] Lock "cinder-a550366f-aec7-4511-ab58-4e11232ec2a7-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:56 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:53:56 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Flow 'volume_create_manager' (20dda994-9baa-49e5-88f9-2ed9e94f0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2262380b-b6c9-4641-baa6-82297da812ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2262380b-b6c9-4641-baa6-82297da812ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1913066829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b11824ac48b8aa95dbc0fcf48784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:57Z,use_quota=True,user_id='569e1e373fb24787abd73c52f7c605d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb8dbf8-b29b-4920-8520-1a28e7b95b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb8dbf8-b29b-4920-8520-1a28e7b95b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134cfc2a-5d26-4ecd-9776-29893d6e1ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134cfc2a-5d26-4ecd-9776-29893d6e1ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4', 'volume_name': 'volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ee79ab-6642-4fcb-9c7c-e093ae6244c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ee79ab-6642-4fcb-9c7c-e093ae6244c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480f1673-7e0a-4ab7-9eef-4336ca4f947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume 238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4', 'volume_size': 1} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1913066829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b11824ac48b8aa95dbc0fcf48784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:53:57Z,use_quota=True,user_id='569e1e373fb24787abd73c52f7c605d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Creating volume 238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:53:56 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:53:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:56 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 1073741824 Apr 28 04:53:56 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:57 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.957s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:53:57 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 1073741824" returned: 0 in 1.127s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:53:57 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 Apr 28 04:53:57 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:53:58 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" returned: 0 in 0.865s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480f1673-7e0a-4ab7-9eef-4336ca4f947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fb860e-6000-48bc-86f6-4d0eb35d4991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:53:58 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 (238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4): created successfully Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fb860e-6000-48bc-86f6-4d0eb35d4991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:53:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Flow 'volume_create_manager' (20dda994-9baa-49e5-88f9-2ed9e94f0110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:53:58 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7e61a5cb-ea42-4f63-a1dc-71c8addad7dd tempest-VolumeQuotasAdminTestJSON-1796076529 None] Created volume successfully. Apr 28 04:53:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "cinder-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "cinder-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "cinder-quobyte-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "cinder-quobyte-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ba5c4-bedc-4a54-87fb-d1cb714ef0e4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:00 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 Apr 28 04:54:00 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:01 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" returned: 0 in 1.216s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:01 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4 Apr 28 04:54:01 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:02 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" returned: 0 in 0.984s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "cinder-quobyte-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4" released by "delete_volume" :: held 2.280s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Created reservations ['503d6590-8903-48bf-be58-14fe322e27ca', '3488d361-3c4e-4b71-8bb7-73421e259d24', '45321231-1241-4d94-a0a3-900eb6a0325f', '35a16b2b-bdb5-4a9a-9e0d-510d23c8c885'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:02 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:02 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:04 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.435s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Deleted volume successfully. Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Flow 'volume_create_manager' (c2380bf0-cd8b-40b3-a85f-7562d8624b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44ea9ca-ca44-4330-9bcd-1a5bfa3b5889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44ea9ca-ca44-4330-9bcd-1a5bfa3b5889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-260872633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b8dfed-5b4d-4715-ab60-0a72e896cace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b11824ac48b8aa95dbc0fcf48784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:04Z,use_quota=True,user_id='569e1e373fb24787abd73c52f7c605d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59454555-387c-4365-a82b-6d708ebe2779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59454555-387c-4365-a82b-6d708ebe2779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35ccfeb-7154-4647-ab41-f2cabd96a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35ccfeb-7154-4647-ab41-f2cabd96a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b8dfed-5b4d-4715-ab60-0a72e896cace', 'volume_name': 'volume-03b8dfed-5b4d-4715-ab60-0a72e896cace', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a587543-524f-4155-b259-a2c8a3adf5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a587543-524f-4155-b259-a2c8a3adf5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd7fee-6bd9-45b0-8c8a-2d97bb608114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:04 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume 03b8dfed-5b4d-4715-ab60-0a72e896cace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b8dfed-5b4d-4715-ab60-0a72e896cace', 'volume_size': 1} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-260872633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b8dfed-5b4d-4715-ab60-0a72e896cace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b11824ac48b8aa95dbc0fcf48784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:04Z,use_quota=True,user_id='569e1e373fb24787abd73c52f7c605d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Creating volume 03b8dfed-5b4d-4715-ab60-0a72e896cace {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:04 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60cf1629-2960-4ceb-89fa-b3f71d2fb709 tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "cinder-238fe0cb-a9fa-43ba-8c8f-2ce4fcadccb4-delete_volume" released by "delete_volume" :: held 4.510s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:04 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace 1073741824 Apr 28 04:54:04 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:05 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace 1073741824" returned: 0 in 1.186s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:05 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace Apr 28 04:54:05 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:06 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace" returned: 0 in 0.754s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd7fee-6bd9-45b0-8c8a-2d97bb608114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b8dfed-5b4d-4715-ab60-0a72e896cace', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3214f-97f5-4c39-9f66-c3336ca29b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:06 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Volume volume-03b8dfed-5b4d-4715-ab60-0a72e896cace (03b8dfed-5b4d-4715-ab60-0a72e896cace): created successfully Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3214f-97f5-4c39-9f66-c3336ca29b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Flow 'volume_create_manager' (c2380bf0-cd8b-40b3-a85f-7562d8624b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:06 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-64337438-aa53-4685-b194-e147609de93f tempest-VolumeQuotasAdminTestJSON-1796076529 None] Created volume successfully. Apr 28 04:54:06 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=109,cinder:UPDATE=117,cinder:INSERT=38,cinder:DELETE=5 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (5d825662-94b5-4578-9cd3-5398fa1cb7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fd395d-20e5-43ab-bbd9-03c6b5e930e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fd395d-20e5-43ab-bbd9-03c6b5e930e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1627595639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f57ec0e-e963-4cf5-8905-d8da1331d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:07Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3078cbf4-3454-4bd0-99b3-45e876f592eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3078cbf4-3454-4bd0-99b3-45e876f592eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac4bf03-d6df-40f2-9ccc-16b5fac3949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac4bf03-d6df-40f2-9ccc-16b5fac3949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f57ec0e-e963-4cf5-8905-d8da1331d2ee', 'volume_name': 'volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a6a637-8b60-465f-934a-40686e323d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a6a637-8b60-465f-934a-40686e323d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf5e730-e795-45d1-a4bb-5e5ced87cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:07 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Volume 3f57ec0e-e963-4cf5-8905-d8da1331d2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee', 'volume_size': 1} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1627595639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f57ec0e-e963-4cf5-8905-d8da1331d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:07Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Creating volume 3f57ec0e-e963-4cf5-8905-d8da1331d2ee {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:07 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:07 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee 1073741824 Apr 28 04:54:07 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:08 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee 1073741824" returned: 0 in 1.120s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:08 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee Apr 28 04:54:08 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4edbb433-cea5-490c-ae60-993db6b64aa6 tempest-VolumeQuotasAdminTestJSON-1392290440 None] Transfer volume completed successfully. Apr 28 04:54:08 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" returned: 0 in 0.681s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf5e730-e795-45d1-a4bb-5e5ced87cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93596193-216e-4a9c-96d1-518f1f0d7539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:08 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Volume volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee (3f57ec0e-e963-4cf5-8905-d8da1331d2ee): created successfully Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93596193-216e-4a9c-96d1-518f1f0d7539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (5d825662-94b5-4578-9cd3-5398fa1cb7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:09 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-51271a4a-577d-4730-8ffb-b07db3789c55 tempest-VolumesListAdminTestJSON-1728164818 None] Created volume successfully. Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Acquiring lock "cinder-03b8dfed-5b4d-4715-ab60-0a72e896cace-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "cinder-03b8dfed-5b4d-4715-ab60-0a72e896cace-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Acquiring lock "cinder-quobyte-03b8dfed-5b4d-4715-ab60-0a72e896cace" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "cinder-quobyte-03b8dfed-5b4d-4715-ab60-0a72e896cace" acquired by "delete_volume" :: waited 0.041s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925803f-b601-409e-a826-df59cbc6ea39]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:09 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (355ac7b4-bebb-46a3-9271-77415a0d5c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:10 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace Apr 28 04:54:10 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3eddd1a-018d-41d3-89c1-bf52cc4720df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3eddd1a-018d-41d3-89c1-bf52cc4720df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1289410341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddfcc33-944d-49bc-b999-1f219b3da13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:10Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44144ce7-6f26-44c2-be1d-a5cbe1e1df18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44144ce7-6f26-44c2-be1d-a5cbe1e1df18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb1e51b-0795-48ca-9242-22ae944363f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb1e51b-0795-48ca-9242-22ae944363f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddfcc33-944d-49bc-b999-1f219b3da13c', 'volume_name': 'volume-5ddfcc33-944d-49bc-b999-1f219b3da13c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8bf65f-e9b5-4f92-8c78-c0136fbfc4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8bf65f-e9b5-4f92-8c78-c0136fbfc4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509be54d-23e5-4cbb-a22d-eef47a65fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:10 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Volume 5ddfcc33-944d-49bc-b999-1f219b3da13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddfcc33-944d-49bc-b999-1f219b3da13c', 'volume_size': 1} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1289410341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddfcc33-944d-49bc-b999-1f219b3da13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:10Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Creating volume 5ddfcc33-944d-49bc-b999-1f219b3da13c {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:10 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:10 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c 1073741824 Apr 28 04:54:10 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:10 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace" returned: 0 in 1.075s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:11 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace Apr 28 04:54:11 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:11 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c 1073741824" returned: 0 in 1.164s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:11 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c Apr 28 04:54:11 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:11 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-03b8dfed-5b4d-4715-ab60-0a72e896cace" returned: 0 in 0.958s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "cinder-quobyte-03b8dfed-5b4d-4715-ab60-0a72e896cace" released by "delete_volume" :: held 2.128s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:11 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=109,cinder:DELETE=11,cinder:SELECT=90,cinder:INSERT=25 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Created reservations ['3088922a-d9f6-4600-8bbb-aa008ce1f1ed', '85efc76d-8807-4549-a83c-6f55c1a2a6fb', '382e143b-8f92-4d62-96bf-e9e205a3ae2d', 'f1ac4708-968a-44e9-bc4f-9ad541d26301'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:12 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:12 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:12 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c" returned: 0 in 0.961s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509be54d-23e5-4cbb-a22d-eef47a65fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddfcc33-944d-49bc-b999-1f219b3da13c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f3a559-a772-45bc-9e2a-d4fc5febe74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:12 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Volume volume-5ddfcc33-944d-49bc-b999-1f219b3da13c (5ddfcc33-944d-49bc-b999-1f219b3da13c): created successfully Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f3a559-a772-45bc-9e2a-d4fc5febe74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (355ac7b4-bebb-46a3-9271-77415a0d5c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-972393a6-244b-4aac-a72e-d557866a1579 tempest-VolumesListAdminTestJSON-1728164818 None] Created volume successfully. Apr 28 04:54:12 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.656s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Deleted volume successfully. Apr 28 04:54:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d4ad4763-9eb3-4665-a7ec-206b209eb72e tempest-VolumeQuotasAdminTestJSON-2111670839 None] Lock "cinder-03b8dfed-5b4d-4715-ab60-0a72e896cace-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (d3d70fac-ccfb-4e44-a599-931456417b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3ac543-8d3b-4a68-b5ed-a0d3b05bdc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3ac543-8d3b-4a68-b5ed-a0d3b05bdc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107492504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3e0061-1d4c-4eb3-95ec-6b8173fb5947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:14Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02432c31-fb6d-4197-a730-20d537223630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02432c31-fb6d-4197-a730-20d537223630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1587d812-ba9c-4785-b0e1-fa0b94c4ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1587d812-ba9c-4785-b0e1-fa0b94c4ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3e0061-1d4c-4eb3-95ec-6b8173fb5947', 'volume_name': 'volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18c697a-33a5-4189-a4f4-3498d38f4413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18c697a-33a5-4189-a4f4-3498d38f4413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc390f2-c961-4722-b0b4-6dc8f382ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:14 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Volume 3b3e0061-1d4c-4eb3-95ec-6b8173fb5947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947', 'volume_size': 1} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107492504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3e0061-1d4c-4eb3-95ec-6b8173fb5947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7f301739a425b8951a4be15118258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:14Z,use_quota=True,user_id='94741f4e5da74c1483889fb0fd76c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Creating volume 3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:14 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:14 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 1073741824 Apr 28 04:54:14 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:15 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 1073741824" returned: 0 in 0.958s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:15 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 Apr 28 04:54:15 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:15 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" returned: 0 in 0.654s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc390f2-c961-4722-b0b4-6dc8f382ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ff3ef0-889c-4d53-a6dc-8dbbd60cdf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-7cb2f5f3-5898-4a98-a304-2efcc43bffb9 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Terminate volume connection completed successfully. Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-7cb2f5f3-5898-4a98-a304-2efcc43bffb9 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Deleting attachment 9899bdcc-789c-4dbe-8141-3f2143e7b151. {{(pid=82097) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 04:54:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Volume volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 (3b3e0061-1d4c-4eb3-95ec-6b8173fb5947): created successfully Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ff3ef0-889c-4d53-a6dc-8dbbd60cdf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Flow 'volume_create_manager' (d3d70fac-ccfb-4e44-a599-931456417b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-99e4e369-85f6-48e7-a744-36cf9f9a6326 tempest-VolumesListAdminTestJSON-1728164818 None] Created volume successfully. Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "cinder-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "cinder-quobyte-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-quobyte-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[49055364-a962-417b-8703-832d99c197d4]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:16 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:54:16 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Flow 'volume_create_manager' (ad35c56a-0c84-4849-93d5-3812588c859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf910a2c-8ca2-4ec2-a1fd-d3f49d3e383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf910a2c-8ca2-4ec2-a1fd-d3f49d3e383a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce921a6-90a5-48d6-80d6-141ac722d638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e29f9f21f0436fa6e15f770fb1e2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:17Z,use_quota=True,user_id='34738c18ad7341a0a8a9f29e42f539ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a631790a-2cbe-42d4-9c37-3df43952b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a631790a-2cbe-42d4-9c37-3df43952b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86e7ee7-b043-41c7-9f99-c6beac94a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86e7ee7-b043-41c7-9f99-c6beac94a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce921a6-90a5-48d6-80d6-141ac722d638', 'volume_name': 'volume-cce921a6-90a5-48d6-80d6-141ac722d638', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af6dc61-ca49-43a9-b9d4-fa0147b4a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af6dc61-ca49-43a9-b9d4-fa0147b4a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740bcae7-f18d-489c-bce0-c3c46c5e2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:17 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Volume cce921a6-90a5-48d6-80d6-141ac722d638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce921a6-90a5-48d6-80d6-141ac722d638', 'volume_size': 1} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce921a6-90a5-48d6-80d6-141ac722d638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e29f9f21f0436fa6e15f770fb1e2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:17Z,use_quota=True,user_id='34738c18ad7341a0a8a9f29e42f539ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Creating volume cce921a6-90a5-48d6-80d6-141ac722d638 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:17 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:17 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 1073741824 Apr 28 04:54:17 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:17 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 1.004s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:17 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:54:17 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:18 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 1073741824" returned: 0 in 0.796s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:18 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 Apr 28 04:54:18 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:18 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 1 in 0.915s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:54:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:18 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a Apr 28 04:54:18 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:19 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638" returned: 0 in 0.983s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740bcae7-f18d-489c-bce0-c3c46c5e2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce921a6-90a5-48d6-80d6-141ac722d638', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f45774-0d5c-4e17-9140-96844972f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:19 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Volume volume-cce921a6-90a5-48d6-80d6-141ac722d638 (cce921a6-90a5-48d6-80d6-141ac722d638): created successfully Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f45774-0d5c-4e17-9140-96844972f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Flow 'volume_create_manager' (ad35c56a-0c84-4849-93d5-3812588c859b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8cc5274f-d60b-4089-9853-805ebb34c31d tempest-VolumesListAdminTestJSON-375282223 None] Created volume successfully. Apr 28 04:54:19 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" returned: 0 in 0.799s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-quobyte-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a" released by "delete_volume" :: held 2.802s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.quota [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Created reservations ['5b15fbc3-33f6-4dcb-9e3a-18142436fba7', '55beea03-bd4f-4df4-bc30-b3a84eade8ae', '7df8e423-41c8-4141-96a6-9a25b66f7476', '142d9891-9f9b-4a97-8808-ee40126be46f'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:19 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:19 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:20 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.730s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.manager [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Deleted volume successfully. Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-fcd626ef-62ca-4013-ab39-59ee9b0ab63e req-dc1ca4ca-094f-4aa6-8e61-307d1163be15 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-b2663840-3b08-4fd2-9fb6-ec86bd25ac1a-delete_volume" released by "delete_volume" :: held 3.819s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Acquiring lock "cinder-cce921a6-90a5-48d6-80d6-141ac722d638-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "cinder-cce921a6-90a5-48d6-80d6-141ac722d638-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Acquiring lock "cinder-quobyte-cce921a6-90a5-48d6-80d6-141ac722d638" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "cinder-quobyte-cce921a6-90a5-48d6-80d6-141ac722d638" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d895e-1f66-4448-b4c4-4dbe3c4102be]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:20 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 Apr 28 04:54:20 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-quobyte-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" acquired by "delete_volume" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aded8a29-16c4-414d-9765-91a10899ed30]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:21 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 Apr 28 04:54:21 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:21 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638" returned: 0 in 0.902s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:21 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638 Apr 28 04:54:21 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:22 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" returned: 0 in 1.221s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:22 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947 Apr 28 04:54:22 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Flow 'volume_create_manager' (e70bc6a8-dd56-4ed6-bf47-212aba52773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230ec58-2c7b-49df-be75-3ac649ab5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230ec58-2c7b-49df-be75-3ac649ab5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1383276177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fc59d7-56f7-41bd-a06f-d87f7298a8b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09212ea0ef2486d8e929e7d20676877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:22Z,use_quota=True,user_id='9680f740cece4bb0968dbb2f5bd1d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:22 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3690a0ac-ff92-4fb9-87d5-40a8707133a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3690a0ac-ff92-4fb9-87d5-40a8707133a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f471d7-8a91-4901-b551-3e8921f000a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f471d7-8a91-4901-b551-3e8921f000a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fc59d7-56f7-41bd-a06f-d87f7298a8b6', 'volume_name': 'volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dde5f64-03a3-4351-be0e-a31ef9182db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dde5f64-03a3-4351-be0e-a31ef9182db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e521a645-ad5d-4c11-8e18-79c873463e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:22 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Volume c9fc59d7-56f7-41bd-a06f-d87f7298a8b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6', 'volume_size': 1} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1383276177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fc59d7-56f7-41bd-a06f-d87f7298a8b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09212ea0ef2486d8e929e7d20676877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:22Z,use_quota=True,user_id='9680f740cece4bb0968dbb2f5bd1d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Creating volume c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:22 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cce921a6-90a5-48d6-80d6-141ac722d638" returned: 0 in 0.879s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:22 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 1073741824 Apr 28 04:54:22 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "cinder-quobyte-cce921a6-90a5-48d6-80d6-141ac722d638" released by "delete_volume" :: held 1.837s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Created reservations ['4e9300ac-c858-4fa2-917f-e1b27f9e18e6', '3e3123b5-2ff5-4212-920c-bfd1ab098c16', 'bda20bca-b642-4146-9fd3-8f897b6cea6c', '6e9ce8c7-2d93-4cf4-8f08-9330cd4f8675'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:22 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:22 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:22 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" returned: 0 in 0.655s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947" released by "delete_volume" :: held 1.944s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Created reservations ['5dfc2dce-7727-4e7f-b5df-3ca086e7cd01', '3e1d551e-9748-4041-b16a-a1e7dca2880c', 'e7f6dd4e-2f50-4b5e-a8d5-c27654655e14', '1f17e617-762b-4e82-83ab-7557ff24a583'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:23 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:23 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:23 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 1073741824" returned: 0 in 0.763s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:23 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.617s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:23 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Deleted volume successfully. Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee020570-5615-4b8a-aca0-0b3e974dc9c8 tempest-VolumesListAdminTestJSON-375282223 None] Lock "cinder-cce921a6-90a5-48d6-80d6-141ac722d638-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-5ddfcc33-944d-49bc-b999-1f219b3da13c-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:23 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-5ddfcc33-944d-49bc-b999-1f219b3da13c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:23 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-quobyte-5ddfcc33-944d-49bc-b999-1f219b3da13c" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-5ddfcc33-944d-49bc-b999-1f219b3da13c" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f650ab-a2e2-4dcb-add9-98215a1fa7c1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:23 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c Apr 28 04:54:23 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:24 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.918s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Deleted volume successfully. Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0c986f1f-6ab8-4590-bb8e-262be8c85902 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-3b3e0061-1d4c-4eb3-95ec-6b8173fb5947-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:24 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" returned: 0 in 0.914s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e521a645-ad5d-4c11-8e18-79c873463e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5f9c23-0eec-48a1-be14-af46dd612ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Volume volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 (c9fc59d7-56f7-41bd-a06f-d87f7298a8b6): created successfully Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5f9c23-0eec-48a1-be14-af46dd612ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Flow 'volume_create_manager' (e70bc6a8-dd56-4ed6-bf47-212aba52773f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b7279a39-907c-4294-8f08-12e94814d2b6 tempest-VolumesServicesTestJSON-1323368052 None] Created volume successfully. Apr 28 04:54:24 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c" returned: 0 in 0.764s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:24 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c Apr 28 04:54:24 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Acquiring lock "cinder-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "cinder-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Acquiring lock "cinder-quobyte-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "cinder-quobyte-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae63e32-8dfa-42bd-ad29-61bae2b087d1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:25 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5ddfcc33-944d-49bc-b999-1f219b3da13c" returned: 0 in 0.562s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-5ddfcc33-944d-49bc-b999-1f219b3da13c" released by "delete_volume" :: held 1.400s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:25 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 Apr 28 04:54:25 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Created reservations ['57658432-8790-425d-8091-306161ce469e', 'b7c0452a-aed1-47bb-80c0-06c2ccabd907', '63966160-619a-4a69-b030-2885cd178f5f', 'a3909217-aa28-45e9-ae3b-bccef22143c6'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:25 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:25 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:25 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" returned: 0 in 0.613s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:25 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6 Apr 28 04:54:25 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:25 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.469s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Deleted volume successfully. Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f38714d7-32d1-437b-8cae-9dbd8b75fea3 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-5ddfcc33-944d-49bc-b999-1f219b3da13c-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-3f57ec0e-e963-4cf5-8905-d8da1331d2ee-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-3f57ec0e-e963-4cf5-8905-d8da1331d2ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "cinder-quobyte-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" acquired by "delete_volume" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b266c6-0416-4ede-89f0-94d93de8b521]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:26 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee Apr 28 04:54:26 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:26 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" returned: 0 in 0.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "cinder-quobyte-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6" released by "delete_volume" :: held 1.202s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Created reservations ['95c8ec48-ee41-4138-b335-860fed6115bf', 'd71b4dd1-5016-4d06-84da-04c9509d4559', '9dd07fae-c9a7-4901-83d8-52df64673d86', '700ffe91-3393-4935-ab5e-853a2d35eb34'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:26 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:26 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:26 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" returned: 0 in 0.576s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:26 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee Apr 28 04:54:26 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:26 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Deleted volume successfully. Apr 28 04:54:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3477c7db-07f1-44b3-88c9-bba1a233c735 tempest-VolumesServicesTestJSON-1323368052 None] Lock "cinder-c9fc59d7-56f7-41bd-a06f-d87f7298a8b6-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:26 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" returned: 0 in 0.508s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-quobyte-3f57ec0e-e963-4cf5-8905-d8da1331d2ee" released by "delete_volume" :: held 1.136s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Created reservations ['8af46304-5f29-478e-812e-5c8819d7b800', '8b86879f-6f01-4ac6-b839-bef718b4aa83', '411d7556-33ed-435a-9fb5-3e4bcc88cf3f', '62316b49-cd58-4849-9b42-7b1accc79823'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:27 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:27 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:27 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.576s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Deleted volume successfully. Apr 28 04:54:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cc67fe8-233d-4037-be2b-214ed8711806 tempest-VolumesListAdminTestJSON-1728164818 None] Lock "cinder-3f57ec0e-e963-4cf5-8905-d8da1331d2ee-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-3f5f0e13-76a0-4b97-bdb5-f52dc50520f6 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Terminate volume connection completed successfully. Apr 28 04:54:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-3f5f0e13-76a0-4b97-bdb5-f52dc50520f6 tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Deleting attachment ab993471-0178-4137-b6a3-4e0db72d2dc0. {{(pid=82097) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "cinder-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "cinder-quobyte-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-quobyte-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfaf6fc-5e4c-48d2-9e4c-ff26357c0f24]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:34 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 Apr 28 04:54:34 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Flow 'volume_create_manager' (5caf328b-1c6e-46b1-9f44-6ff521b4bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4862fa6-fd99-4b6b-a5da-d31e1d28edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4862fa6-fd99-4b6b-a5da-d31e1d28edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1399102661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ea9b68-e6a5-4b82-95ad-0b3f93a46310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a292742a74f9b854f35ed694562ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:34Z,use_quota=True,user_id='74e6b2926aac4a0ba43b4f5eb24712b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cd7a2-ef4b-4e5e-9379-c2f7b5aa74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cd7a2-ef4b-4e5e-9379-c2f7b5aa74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1df21f3-bfdc-46a1-9011-1174b1fa6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.image.glance [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Creating Keystone auth plugin from conf {{(pid=82097) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1df21f3-bfdc-46a1-9011-1174b1fa6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1ea9b68-e6a5-4b82-95ad-0b3f93a46310', 'volume_name': 'volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ec317b-75bd-4e19-914f-38a30d2ac432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ec317b-75bd-4e19-914f-38a30d2ac432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a47ef59-931c-406e-8951-903b0deaa8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:34 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 04:54:34 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Trying to clone c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]). {{(pid=82097) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Flow 'volume_create_manager' (eb3856f0-e38d-49f9-b2c6-3cd20e12ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cf49e2-5c93-43e5-a9f0-ab309e5cec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cf49e2-5c93-43e5-a9f0-ab309e5cec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-336027596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6e90d-c5d9-425e-b634-c21ef66a80cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9ebdee0e2b4cb886f450eaae45c79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:35Z,use_quota=True,user_id='e2a097171d12441494095485b4fcc2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90904535-9834-455b-bc8c-672d1ac2b12c),volume_type_id=90904535-9834-455b-bc8c-672d1ac2b12c)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a584ee4f-854f-4de6-8cb3-d1e7f34c9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a584ee4f-854f-4de6-8cb3-d1e7f34c9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c84e560-a8e1-4f31-aa01-a39669eacc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c84e560-a8e1-4f31-aa01-a39669eacc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b6e90d-c5d9-425e-b634-c21ef66a80cf', 'volume_name': 'volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347723f2-b6dd-444a-9df3-8695eda6e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:35 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347723f2-b6dd-444a-9df3-8695eda6e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d272c0-01fd-4a40-8d85-a2d5fb1f3f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:35 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Volume 29b6e90d-c5d9-425e-b634-c21ef66a80cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf', 'volume_size': 1} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-336027596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6e90d-c5d9-425e-b634-c21ef66a80cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9ebdee0e2b4cb886f450eaae45c79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:35Z,use_quota=True,user_id='e2a097171d12441494095485b4fcc2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90904535-9834-455b-bc8c-672d1ac2b12c),volume_type_id=90904535-9834-455b-bc8c-672d1ac2b12c)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Creating volume 29b6e90d-c5d9-425e-b634-c21ef66a80cf {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:35 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" returned: 0 in 0.926s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:35 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf 1073741824 Apr 28 04:54:35 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:35 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609 Apr 28 04:54:35 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 04:54:35 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Image download 20.69 MB at 20.69 MB/s Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a9d9a-1e0e-4f23-b9f4-35bb7a663153]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:35 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD Apr 28 04:54:35 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:35 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" returned: 0 in 0.561s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-quobyte-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609" released by "delete_volume" :: held 1.557s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.quota [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Created reservations ['73c5c5aa-bb8b-48e4-8fb8-de296986c223', '5ef8cc6b-f98e-4856-8a0d-003f0d3449b0', '1a2c0b17-fe10-4bf2-9f4f-14a9d1382159', 'f5dda1ae-9e99-481c-87d7-75f041015f46'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:35 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf 1073741824" returned: 0 in 0.835s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:35 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:35 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:36 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf Apr 28 04:54:36 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:36 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD" returned: 0 in 0.673s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 is fetched for user 74e6b2926aac4a0ba43b4f5eb24712b4. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dcd400-91d8-4291-84a6-b99f4829e9bb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:36 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD Apr 28 04:54:36 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:36 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.605s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.manager [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Deleted volume successfully. Apr 28 04:54:36 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf" returned: 0 in 0.546s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [req-5bae21b8-f543-451e-b9c2-8627c0a55da7 req-f50c2d6e-2711-4adb-9d8a-747e4639cd4d tempest-ServerBootFromVolumeStableRescueTest-1822473452 None] Lock "cinder-3e0b1b8a-6f1d-44e1-bb06-587e2b73a609-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d272c0-01fd-4a40-8d85-a2d5fb1f3f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4c7898-b0cc-40b3-8d5d-1bcfc1bc5439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:36 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Volume volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf (29b6e90d-c5d9-425e-b634-c21ef66a80cf): created successfully Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4c7898-b0cc-40b3-8d5d-1bcfc1bc5439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Flow 'volume_create_manager' (eb3856f0-e38d-49f9-b2c6-3cd20e12ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-90078463-e86a-4968-aeb6-8edca5ca927b tempest-VolumeTypesAccessTest-468112438 None] Created volume successfully. Apr 28 04:54:36 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1399102661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ea9b68-e6a5-4b82-95ad-0b3f93a46310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a292742a74f9b854f35ed694562ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:34Z,use_quota=True,user_id='74e6b2926aac4a0ba43b4f5eb24712b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Creating volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:36 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:36 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1073741824 Apr 28 04:54:36 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Acquiring lock "cinder-29b6e90d-c5d9-425e-b634-c21ef66a80cf-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "cinder-29b6e90d-c5d9-425e-b634-c21ef66a80cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Acquiring lock "cinder-quobyte-29b6e90d-c5d9-425e-b634-c21ef66a80cf" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "cinder-quobyte-29b6e90d-c5d9-425e-b634-c21ef66a80cf" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdfd223-3d2e-4b45-8755-62c499492dd1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:37 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf Apr 28 04:54:37 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:37 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1073741824" returned: 0 in 0.841s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:37 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:37 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:37 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf" returned: 0 in 0.641s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:37 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf Apr 28 04:54:37 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:38 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Attempting download of 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198b177-ddc3-4183-aceb-b2bb87c7fb2a]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:38 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc Apr 28 04:54:38 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:38 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-29b6e90d-c5d9-425e-b634-c21ef66a80cf" returned: 0 in 0.607s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "cinder-quobyte-29b6e90d-c5d9-425e-b634-c21ef66a80cf" released by "delete_volume" :: held 1.318s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:38 devstack cinder-volume[82097]: WARNING cinder.quota [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-850927177 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-850927177, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:54:38 devstack cinder-volume[82097]: WARNING cinder.quota [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-850927177 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-850927177, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Created reservations ['eb9fe3ee-02f4-40b6-9ba5-44c22fb85e51', 'edbce8b9-bed1-4bb7-b38f-5f9ab82e90c2', '81c1771d-55ef-420e-8523-b8b96c67ce73', '5a935ac9-d5c6-4593-a194-1472e0f5a907'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:38 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:38 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:39 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc" returned: 0 in 0.898s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:39 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc Apr 28 04:54:39 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:39 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.784s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:39 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Deleted volume successfully. Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9e3f62-05c0-4820-931d-2e3b902a2ed4 tempest-VolumeTypesAccessTest-468112438 None] Lock "cinder-29b6e90d-c5d9-425e-b634-c21ef66a80cf-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:39 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc" returned: 1 in 0.894s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_b87skkwc' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609a56b-24d3-4a06-afa2-4fca9573e9c4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:40 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD Apr 28 04:54:40 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:40 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:40 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 was qcow2, converting to raw {{(pid=82097) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 04:54:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:40 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:40 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:42 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 0 in 2.122s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:42 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_xyygsp3hdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:54:42 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Converted 112.00 MB image at 52.73 MB/s Apr 28 04:54:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:42 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1G Apr 28 04:54:42 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:44 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (89aaefa9-99cf-4b8f-894f-ec97d8b098db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec35e335-1ddf-4ed0-b59c-bc8520953daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 1G" returned: 0 in 1.203s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2b11fa-0655-4804-b370-b4ae11919d68]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec35e335-1ddf-4ed0-b59c-bc8520953daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37457969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d52071-00eb-4078-b484-f4bacb82be8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:44Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:44 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:44 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ea84ff-e4eb-4e5d-8fcc-2bc1430b705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ea84ff-e4eb-4e5d-8fcc-2bc1430b705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49b3b5b-7dd9-4c9e-a23d-1a7d8dc2474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49b3b5b-7dd9-4c9e-a23d-1a7d8dc2474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d52071-00eb-4078-b484-f4bacb82be8c', 'volume_name': 'volume-93d52071-00eb-4078-b484-f4bacb82be8c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a065173-0562-4cad-8ecd-53f2320e3c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a065173-0562-4cad-8ecd-53f2320e3c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8d8458-08a5-4e2c-a57d-7df385b93082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:44 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Volume 93d52071-00eb-4078-b484-f4bacb82be8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d52071-00eb-4078-b484-f4bacb82be8c', 'volume_size': 1} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37457969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d52071-00eb-4078-b484-f4bacb82be8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:44Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Creating volume 93d52071-00eb-4078-b484-f4bacb82be8c {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:44 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:44 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c 1073741824 Apr 28 04:54:44 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:45 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 0 in 0.992s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:45 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:45 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:45 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c 1073741824" returned: 0 in 0.890s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:45 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c Apr 28 04:54:45 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:45 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 1 in 0.724s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Downloaded image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 successfully. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 for user 74e6b2926aac4a0ba43b4f5eb24712b4 is deleted. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Marking volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 as bootable. {{(pid=82097) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Copying metadata from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 to c1ea9b68-e6a5-4b82-95ad-0b3f93a46310. {{(pid=82097) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 04:54:45 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Creating volume glance metadata for volume c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 backed by image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82097) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a47ef59-931c-406e-8951-903b0deaa8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c133fb3f-7025-486d-bfda-bd6c0102da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Volume volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 (c1ea9b68-e6a5-4b82-95ad-0b3f93a46310): created successfully Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c133fb3f-7025-486d-bfda-bd6c0102da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Flow 'volume_create_manager' (5caf328b-1c6e-46b1-9f44-6ff521b4bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:46 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c" returned: 0 in 0.855s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e6622efb-14bd-4dae-b340-6aaae3ab5e9b tempest-VolumesImageMetadata-1325481984 None] Created volume successfully. Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8d8458-08a5-4e2c-a57d-7df385b93082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d52071-00eb-4078-b484-f4bacb82be8c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95555dff-3903-477d-97b5-831a1fe95dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Volume volume-93d52071-00eb-4078-b484-f4bacb82be8c (93d52071-00eb-4078-b484-f4bacb82be8c): created successfully Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95555dff-3903-477d-97b5-831a1fe95dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (89aaefa9-99cf-4b8f-894f-ec97d8b098db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-988ff248-7135-4608-b779-785f71563091 tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Acquiring lock "cinder-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "cinder-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Acquiring lock "cinder-quobyte-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "cinder-quobyte-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" acquired by "delete_volume" :: waited 0.036s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca66b4b1-a0e9-4c64-83a5-623940cbfcef]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e7827763-a2d6-49a0-9aa3-72cdd33557ea tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c" by "attach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e7827763-a2d6-49a0-9aa3-72cdd33557ea tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c" acquired by "attach_volume" :: waited 0.042s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:47 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:47 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e7827763-a2d6-49a0-9aa3-72cdd33557ea tempest-VolumesActionsTest-398146747 None] Attaching volume 93d52071-00eb-4078-b484-f4bacb82be8c to instance ae2a7e7f-2c43-408e-af6f-6766b6b5f307 at mountpoint /dev/vdb on host None. Apr 28 04:54:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e7827763-a2d6-49a0-9aa3-72cdd33557ea tempest-VolumesActionsTest-398146747 None] Attach volume completed successfully. Apr 28 04:54:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e7827763-a2d6-49a0-9aa3-72cdd33557ea tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c" released by "attach_volume" :: held 0.223s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:48 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 0 in 1.081s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:48 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:48 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Terminate volume connection completed successfully. Apr 28 04:54:49 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 1 in 1.068s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:49 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310 Apr 28 04:54:49 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" by "detach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Detaching volume 93d52071-00eb-4078-b484-f4bacb82be8c from instance ae2a7e7f-2c43-408e-af6f-6766b6b5f307. Apr 28 04:54:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Detach volume completed successfully. Apr 28 04:54:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-08b4ada3-3c5d-46b8-ba8d-d72c03d5517c tempest-VolumesActionsTest-287659146 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:50 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" returned: 0 in 0.792s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "cinder-quobyte-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310" released by "delete_volume" :: held 3.023s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa57a103-1919-40cb-a120-a92ecd88121d tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" by "detach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Created reservations ['c1fe36ba-86bc-4a43-8a07-69ac07210c52', '4e901c78-a0e9-4564-bdbb-591b797d3f2f', '7b14eb1a-c74a-49ff-b105-33a3fb83ad0e', '9028a770-6718-43a5-b3a3-b9ae6c80cbb0'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa57a103-1919-40cb-a120-a92ecd88121d tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:50 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aa57a103-1919-40cb-a120-a92ecd88121d tempest-VolumesActionsTest-398146747 None] Volume detach called, but volume not attached. Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa57a103-1919-40cb-a120-a92ecd88121d tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:50 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:50 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-quobyte-93d52071-00eb-4078-b484-f4bacb82be8c" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "cinder-quobyte-93d52071-00eb-4078-b484-f4bacb82be8c" acquired by "delete_volume" :: waited 0.059s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038d004-402d-403e-a42a-098c9b9756c6]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:51 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.196s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:51 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c Apr 28 04:54:51 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:51 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Deleted volume successfully. Apr 28 04:54:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f4943081-213d-4a88-9d66-e08e413cd145 tempest-VolumesImageMetadata-1325481984 None] Lock "cinder-c1ea9b68-e6a5-4b82-95ad-0b3f93a46310-delete_volume" released by "delete_volume" :: held 4.552s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:52 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c" returned: 0 in 1.135s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:52 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c Apr 28 04:54:52 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:53 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-93d52071-00eb-4078-b484-f4bacb82be8c" returned: 0 in 0.744s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "cinder-quobyte-93d52071-00eb-4078-b484-f4bacb82be8c" released by "delete_volume" :: held 1.935s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Created reservations ['5ba5766f-0385-4aff-bcfb-1d0ae497f936', '12a527af-9846-4957-b7d0-ed807de1baba', '75adfce0-8d48-4648-aa73-ccd01203ecc2', 'a2e60648-1133-41a4-96d8-9b1313ad7210'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:53 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:53 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:53 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:53 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:53 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Deleted volume successfully. Apr 28 04:54:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92b17f9a-3f04-43bf-a6a3-417232eaf705 tempest-VolumesActionsTest-398146747 None] Lock "cinder-93d52071-00eb-4078-b484-f4bacb82be8c-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:56 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:54:56 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:57 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.676s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Flow 'volume_create_manager' (90242a6d-217d-464a-b098-3b05cc712937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57961ade-6a05-4837-9650-e4b32124748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57961ade-6a05-4837-9650-e4b32124748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-609026211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d7281e-6a71-452e-a5c3-63ee8fdb10a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684c796b134f418fbae3a20253d01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:58Z,use_quota=True,user_id='27415112618b42ef86274c0d5d3adecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2b4a5f-cde1-4e70-8f28-60576f0b25da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2b4a5f-cde1-4e70-8f28-60576f0b25da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb86c807-75da-4c07-819f-a18371e0e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb86c807-75da-4c07-819f-a18371e0e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d7281e-6a71-452e-a5c3-63ee8fdb10a6', 'volume_name': 'volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e212f6-16ef-4d2b-be8c-c67d6ae733e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e212f6-16ef-4d2b-be8c-c67d6ae733e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4ae98-d659-4fa3-a9e9-cf98a662fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Volume 66d7281e-6a71-452e-a5c3-63ee8fdb10a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6', 'volume_size': 1} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-609026211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d7281e-6a71-452e-a5c3-63ee8fdb10a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684c796b134f418fbae3a20253d01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:58Z,use_quota=True,user_id='27415112618b42ef86274c0d5d3adecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Creating volume 66d7281e-6a71-452e-a5c3-63ee8fdb10a6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:57 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:57 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 1073741824 Apr 28 04:54:57 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:58 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 1073741824" returned: 0 in 0.770s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:58 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 Apr 28 04:54:58 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Flow 'volume_create_manager' (b1eeeff9-0ed6-4b71-b744-a0a1f347e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66da4b23-c1ab-4717-92f8-26adb77897be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66da4b23-c1ab-4717-92f8-26adb77897be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-449899359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96f961b-72d8-4737-8013-86453d686630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76dbff6c12324effb17ef5be909ebcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:59Z,use_quota=True,user_id='aba6af423d9c4915912f0a0fcadc7d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97de4f8-3b28-4ec8-a114-e2389ac5da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97de4f8-3b28-4ec8-a114-e2389ac5da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d01d6f-c130-4ad8-a028-2fca010dc705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d01d6f-c130-4ad8-a028-2fca010dc705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96f961b-72d8-4737-8013-86453d686630', 'volume_name': 'volume-d96f961b-72d8-4737-8013-86453d686630', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdd816-c147-4495-8887-eb77228ace68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdd816-c147-4495-8887-eb77228ace68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d401e5d-65ea-4f4b-a2ac-5ff52bc6aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Volume d96f961b-72d8-4737-8013-86453d686630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96f961b-72d8-4737-8013-86453d686630', 'volume_size': 1} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:59 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" returned: 0 in 0.659s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-449899359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96f961b-72d8-4737-8013-86453d686630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76dbff6c12324effb17ef5be909ebcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:54:59Z,use_quota=True,user_id='aba6af423d9c4915912f0a0fcadc7d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Creating volume d96f961b-72d8-4737-8013-86453d686630 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:54:59 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4ae98-d659-4fa3-a9e9-cf98a662fefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77820ae-307a-4d7e-862d-0c5697a93aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:54:59 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 1073741824 Apr 28 04:54:59 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:54:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Volume volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 (66d7281e-6a71-452e-a5c3-63ee8fdb10a6): created successfully Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77820ae-307a-4d7e-862d-0c5697a93aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:54:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Flow 'volume_create_manager' (90242a6d-217d-464a-b098-3b05cc712937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:54:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1b137d64-59c9-4d17-854d-93c5160f85f2 tempest-VolumesTransfersV357Test-990644005 None] Created volume successfully. Apr 28 04:55:00 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 1073741824" returned: 0 in 0.730s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:00 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 Apr 28 04:55:00 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:01 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630" returned: 0 in 0.901s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:01 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f2595b57-6fb8-4f23-a74b-5ecc8b0c0e83 tempest-VolumesTransfersV357Test-1141799429 None] Transfer volume completed successfully. Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d401e5d-65ea-4f4b-a2ac-5ff52bc6aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96f961b-72d8-4737-8013-86453d686630', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99341534-45bc-45c1-b915-bfacc35ee906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:01 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Volume volume-d96f961b-72d8-4737-8013-86453d686630 (d96f961b-72d8-4737-8013-86453d686630): created successfully Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99341534-45bc-45c1-b915-bfacc35ee906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Flow 'volume_create_manager' (b1eeeff9-0ed6-4b71-b744-a0a1f347e43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:01 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d13c9961-945b-4557-a141-c10e47d53e73 tempest-VolumesMetadataTest-265928205 None] Created volume successfully. Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Acquiring lock "cinder-d96f961b-72d8-4737-8013-86453d686630-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "cinder-d96f961b-72d8-4737-8013-86453d686630-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Acquiring lock "cinder-quobyte-d96f961b-72d8-4737-8013-86453d686630" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "cinder-quobyte-d96f961b-72d8-4737-8013-86453d686630" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf16bb-17ed-42ea-9cb0-4059540fe9c0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:02 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 Apr 28 04:55:02 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "cinder-66d7281e-6a71-452e-a5c3-63ee8fdb10a6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-66d7281e-6a71-452e-a5c3-63ee8fdb10a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "cinder-quobyte-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-quobyte-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130c367-6a1d-4a90-b654-eca357d7a184]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:02 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 Apr 28 04:55:02 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (66dc74cc-6344-466a-adfa-c0fc0d2606e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95c79f-9934-4932-b092-809215c3c880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:03 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95c79f-9934-4932-b092-809215c3c880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169107972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b26260d-a5b2-48a6-9cdf-233442b74af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:03Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a27d781-8d2a-4883-923a-57c500a394ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a27d781-8d2a-4883-923a-57c500a394ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c099085-6307-4926-be42-fa10d99942e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c099085-6307-4926-be42-fa10d99942e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b26260d-a5b2-48a6-9cdf-233442b74af1', 'volume_name': 'volume-8b26260d-a5b2-48a6-9cdf-233442b74af1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c880b35f-b173-4b87-9d2e-38b6e7007cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c880b35f-b173-4b87-9d2e-38b6e7007cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfe37b6-d32a-4817-af43-bd898ed1cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:03 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Volume 8b26260d-a5b2-48a6-9cdf-233442b74af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b26260d-a5b2-48a6-9cdf-233442b74af1', 'volume_size': 1} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169107972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b26260d-a5b2-48a6-9cdf-233442b74af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:03Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Creating volume 8b26260d-a5b2-48a6-9cdf-233442b74af1 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:03 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630" returned: 0 in 0.906s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:03 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 1073741824 Apr 28 04:55:03 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:03 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630 Apr 28 04:55:03 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:03 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" returned: 0 in 0.931s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:03 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6 Apr 28 04:55:03 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:03 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d96f961b-72d8-4737-8013-86453d686630" returned: 0 in 0.605s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "cinder-quobyte-d96f961b-72d8-4737-8013-86453d686630" released by "delete_volume" :: held 1.560s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Created reservations ['aca66035-d199-4e1e-a539-67f0843b1dc3', '2eb469b1-ed1a-45f7-a2d5-9cb9f8914cd7', 'c05365a0-6a36-4521-b1c6-6a85c65bbb43', 'c0fad379-36db-46bb-9627-9a5ee831fee4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:03 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:03 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:03 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 1073741824" returned: 0 in 0.857s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:04 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 Apr 28 04:55:04 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:04 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" returned: 0 in 0.720s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-quobyte-66d7281e-6a71-452e-a5c3-63ee8fdb10a6" released by "delete_volume" :: held 1.715s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Created reservations ['f86a1e3d-2df0-49b4-be8a-22839407f143', 'cbca8e7c-92be-43f0-b11f-e681dfa231db', '5307b165-582b-438f-9bd4-7dff95db8f72', 'a71f0519-6ed0-4e59-b791-c4feaeb2ab34'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:04 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:04 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:04 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.823s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Deleted volume successfully. Apr 28 04:55:04 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d69878e-2903-4a25-9355-f0ca2a607cd7 tempest-VolumesMetadataTest-265928205 None] Lock "cinder-d96f961b-72d8-4737-8013-86453d686630-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1" returned: 0 in 0.781s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfe37b6-d32a-4817-af43-bd898ed1cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b26260d-a5b2-48a6-9cdf-233442b74af1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd08929-a107-428a-94e4-e30f71996006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:04 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Volume volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 (8b26260d-a5b2-48a6-9cdf-233442b74af1): created successfully Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd08929-a107-428a-94e4-e30f71996006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (66dc74cc-6344-466a-adfa-c0fc0d2606e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-59ff0e97-3ee8-4560-800f-04b5a8c4dc44 tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:55:05 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.858s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Deleted volume successfully. Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6755ef09-4cf3-456e-81e9-81a310aa0c74 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-66d7281e-6a71-452e-a5c3-63ee8fdb10a6-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-8b26260d-a5b2-48a6-9cdf-233442b74af1-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Flow 'volume_create_manager' (636d2784-5661-42b4-84a6-4b6fee135f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363751b1-bb83-44ac-bf56-027d1d29e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "cinder-8b26260d-a5b2-48a6-9cdf-233442b74af1-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363751b1-bb83-44ac-bf56-027d1d29e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-319173187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23407141-fd98-4f38-8b90-fd212cb50a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684c796b134f418fbae3a20253d01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:05Z,use_quota=True,user_id='27415112618b42ef86274c0d5d3adecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a2f05-31bb-40b4-ab37-1b6c2a57706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a2f05-31bb-40b4-ab37-1b6c2a57706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62040b77-b98d-49f6-9264-d31e5e07edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62040b77-b98d-49f6-9264-d31e5e07edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23407141-fd98-4f38-8b90-fd212cb50a34', 'volume_name': 'volume-23407141-fd98-4f38-8b90-fd212cb50a34', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24eb506-f6d5-4010-ac64-89b0b65ae818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24eb506-f6d5-4010-ac64-89b0b65ae818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924a4f60-b3c5-44c5-9ab1-89284e290760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:05 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Volume 23407141-fd98-4f38-8b90-fd212cb50a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23407141-fd98-4f38-8b90-fd212cb50a34', 'volume_size': 1} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-319173187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23407141-fd98-4f38-8b90-fd212cb50a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684c796b134f418fbae3a20253d01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:05Z,use_quota=True,user_id='27415112618b42ef86274c0d5d3adecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Creating volume 23407141-fd98-4f38-8b90-fd212cb50a34 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:05 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:05 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 1073741824 Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-quobyte-8b26260d-a5b2-48a6-9cdf-233442b74af1" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:05 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-8b26260d-a5b2-48a6-9cdf-233442b74af1" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f850572-6e38-4a71-bb68-6fe341fda4ef]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:05 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 Apr 28 04:55:05 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:06 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1" returned: 0 in 0.792s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:06 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 1073741824" returned: 0 in 0.920s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:06 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1 Apr 28 04:55:06 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:06 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 Apr 28 04:55:06 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:07 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34" returned: 0 in 0.617s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924a4f60-b3c5-44c5-9ab1-89284e290760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23407141-fd98-4f38-8b90-fd212cb50a34', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed1bffe-2ff8-4323-86bf-1b994e289cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=141,cinder:SELECT=109,cinder:DELETE=10,cinder:INSERT=29 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:55:07 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Volume volume-23407141-fd98-4f38-8b90-fd212cb50a34 (23407141-fd98-4f38-8b90-fd212cb50a34): created successfully Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed1bffe-2ff8-4323-86bf-1b994e289cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:07 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Flow 'volume_create_manager' (636d2784-5661-42b4-84a6-4b6fee135f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8b26260d-a5b2-48a6-9cdf-233442b74af1" returned: 0 in 0.778s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:07 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-dc56bcb5-4be0-4b73-9b89-367326ab2e19 tempest-VolumesTransfersV357Test-990644005 None] Created volume successfully. Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-8b26260d-a5b2-48a6-9cdf-233442b74af1" released by "delete_volume" :: held 1.624s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Created reservations ['5c5121c5-8cd8-48bf-b31e-060f8dcd8a7e', 'c65c9d79-fd38-46e7-93d8-5a4290ad9ab1', 'e073c633-9668-4ce2-a928-c006dc1dff4b', '8d1e5506-8868-4ddf-96ec-921cb3a2e2ec'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:07 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:07 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "cinder-23407141-fd98-4f38-8b90-fd212cb50a34-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-23407141-fd98-4f38-8b90-fd212cb50a34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "cinder-quobyte-23407141-fd98-4f38-8b90-fd212cb50a34" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-quobyte-23407141-fd98-4f38-8b90-fd212cb50a34" acquired by "delete_volume" :: waited 0.039s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e39c5ed-399d-4dac-82f8-6726e4a1498a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:08 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 Apr 28 04:55:08 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:08 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.728s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Deleted volume successfully. Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-853e6c07-41d0-42cf-b582-8af97c7585e7 tempest-VolumesActionsTest-287659146 None] Lock "cinder-8b26260d-a5b2-48a6-9cdf-233442b74af1-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (33f9e941-c8de-4af0-ae95-95da3a6f008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab88a8fd-89d2-4344-8b02-7b7f620aa5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab88a8fd-89d2-4344-8b02-7b7f620aa5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648490153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e5379-a7a4-42a2-9f7c-e052e12506e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:08Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea79d805-e463-43c3-b48b-83ecf7dfd9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea79d805-e463-43c3-b48b-83ecf7dfd9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f876875-9e20-43b4-8caf-c667611af164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f876875-9e20-43b4-8caf-c667611af164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0e5379-a7a4-42a2-9f7c-e052e12506e0', 'volume_name': 'volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641f8439-c621-4381-b933-063f557e8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641f8439-c621-4381-b933-063f557e8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab8dcb1-468f-44c1-b6f8-ff9d816ac8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:08 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Volume be0e5379-a7a4-42a2-9f7c-e052e12506e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0', 'volume_size': 1} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648490153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e5379-a7a4-42a2-9f7c-e052e12506e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:08Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Creating volume be0e5379-a7a4-42a2-9f7c-e052e12506e0 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:08 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:08 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 1073741824 Apr 28 04:55:08 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:08 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34" returned: 0 in 0.807s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:08 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34 Apr 28 04:55:08 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:09 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 1073741824" returned: 0 in 0.871s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:09 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 Apr 28 04:55:09 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:09 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-23407141-fd98-4f38-8b90-fd212cb50a34" returned: 0 in 0.657s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-quobyte-23407141-fd98-4f38-8b90-fd212cb50a34" released by "delete_volume" :: held 1.520s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Created reservations ['bfe83822-2080-41a3-8fde-7aa385345ca4', '68f6ef6d-df50-432c-8d4d-aa5293c1d716', '3caa6ddb-1f72-4a81-8f46-dc07d1691086', '01262117-c3c6-476c-b652-1ff346e4fad2'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:09 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:09 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:10 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0" returned: 0 in 0.587s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab8dcb1-468f-44c1-b6f8-ff9d816ac8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5552da8c-eb8e-43ec-9e1d-c7a930139181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Volume volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 (be0e5379-a7a4-42a2-9f7c-e052e12506e0): created successfully Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5552da8c-eb8e-43ec-9e1d-c7a930139181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (33f9e941-c8de-4af0-ae95-95da3a6f008b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2df5310a-640b-4b42-ac91-76f92a56fb1c tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:55:10 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.616s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Deleted volume successfully. Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8877cbd9-99ee-4a61-846d-4179b1f1aed0 tempest-VolumesTransfersV357Test-833792273 None] Lock "cinder-23407141-fd98-4f38-8b90-fd212cb50a34-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Flow 'volume_create_manager' (33439015-57e3-454c-b8a0-8bbd36757392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84126ac-73c5-4c93-865b-944cc8314df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84126ac-73c5-4c93-865b-944cc8314df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-252113153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f17e415-a0cb-4fa2-9338-37db4ba51740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9091b01b004bc9aa37a08f4707d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:10Z,use_quota=True,user_id='e6c57c1ef94c49ce910feefc285d260f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf80bec-f34e-4005-b291-e41873efd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf80bec-f34e-4005-b291-e41873efd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d78704-e2f0-4da0-8915-4df590d436be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d78704-e2f0-4da0-8915-4df590d436be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f17e415-a0cb-4fa2-9338-37db4ba51740', 'volume_name': 'volume-8f17e415-a0cb-4fa2-9338-37db4ba51740', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d986fc-5431-4d94-af1f-d9463bcd90b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d986fc-5431-4d94-af1f-d9463bcd90b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ed0de6-d5e9-4d3f-a44a-ddb0a46baec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:10 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Volume 8f17e415-a0cb-4fa2-9338-37db4ba51740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f17e415-a0cb-4fa2-9338-37db4ba51740', 'volume_size': 1} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-252113153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f17e415-a0cb-4fa2-9338-37db4ba51740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9091b01b004bc9aa37a08f4707d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:10Z,use_quota=True,user_id='e6c57c1ef94c49ce910feefc285d260f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Creating volume 8f17e415-a0cb-4fa2-9338-37db4ba51740 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:10 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:10 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 1073741824 Apr 28 04:55:10 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-be0e5379-a7a4-42a2-9f7c-e052e12506e0-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "cinder-be0e5379-a7a4-42a2-9f7c-e052e12506e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-quobyte-be0e5379-a7a4-42a2-9f7c-e052e12506e0" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-be0e5379-a7a4-42a2-9f7c-e052e12506e0" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b561109-1f88-4421-a350-ba8ae64dd875]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:10 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 Apr 28 04:55:10 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:11 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 1073741824" returned: 0 in 0.827s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:11 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 Apr 28 04:55:11 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:11 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0" returned: 0 in 0.682s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:11 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0 Apr 28 04:55:11 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:11 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740" returned: 0 in 0.478s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ed0de6-d5e9-4d3f-a44a-ddb0a46baec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f17e415-a0cb-4fa2-9338-37db4ba51740', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f09519-91a9-42b7-88e9-65d2b4fb46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:11 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Volume volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 (8f17e415-a0cb-4fa2-9338-37db4ba51740): created successfully Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f09519-91a9-42b7-88e9-65d2b4fb46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Flow 'volume_create_manager' (33439015-57e3-454c-b8a0-8bbd36757392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:11 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9f86d3e0-1876-4607-b626-dcb53d8bae23 tempest-VolumesTransfersTest-164247234 None] Created volume successfully. Apr 28 04:55:12 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-be0e5379-a7a4-42a2-9f7c-e052e12506e0" returned: 0 in 0.587s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-be0e5379-a7a4-42a2-9f7c-e052e12506e0" released by "delete_volume" :: held 1.315s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:INSERT=53,cinder:UPDATE=165,cinder:SELECT=111,cinder:DELETE=18 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Created reservations ['b402509c-99d3-42b7-b849-2f184d381b29', 'de78ebc7-e416-4fcf-a6da-6e27178477bf', '4e84a4b6-12e1-4dd4-84f2-86364e637304', '0fcbccae-f0ad-4613-89df-137a49a1ede1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:12 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:12 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:12 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.659s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:12 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Deleted volume successfully. Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9711224c-e763-4fc1-959c-8c6a7ca8b6c4 tempest-VolumesActionsTest-287659146 None] Lock "cinder-be0e5379-a7a4-42a2-9f7c-e052e12506e0-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c6bafa15-81fb-441e-ba07-46b66772f078 tempest-VolumesTransfersTest-1209326180 None] Transfer volume completed successfully. Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (41332d26-c7d9-4dfc-827c-9e212e2134f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bbf191-9884-4a0b-b6e7-171344056e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bbf191-9884-4a0b-b6e7-171344056e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197432847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e42ab6-7f7b-49f8-9af8-260526dfdf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:14Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af65256-ad6b-4b7a-8325-c13917bd05b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af65256-ad6b-4b7a-8325-c13917bd05b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef8ed8f-84f3-4753-a034-e3eb1df389a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef8ed8f-84f3-4753-a034-e3eb1df389a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e42ab6-7f7b-49f8-9af8-260526dfdf12', 'volume_name': 'volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394f9e0f-e920-47b2-96a1-fc9a9856227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394f9e0f-e920-47b2-96a1-fc9a9856227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb83da1-4158-4b83-8aa7-7a138806b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:13 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Volume f1e42ab6-7f7b-49f8-9af8-260526dfdf12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12', 'volume_size': 1} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197432847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e42ab6-7f7b-49f8-9af8-260526dfdf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:14Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Creating volume f1e42ab6-7f7b-49f8-9af8-260526dfdf12 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:13 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:13 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 1073741824 Apr 28 04:55:13 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:14 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 1073741824" returned: 0 in 0.908s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:14 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 Apr 28 04:55:14 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "cinder-8f17e415-a0cb-4fa2-9338-37db4ba51740-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-8f17e415-a0cb-4fa2-9338-37db4ba51740-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "cinder-quobyte-8f17e415-a0cb-4fa2-9338-37db4ba51740" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-quobyte-8f17e415-a0cb-4fa2-9338-37db4ba51740" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eda6f7-d07b-4afb-a9e4-4c0c4cb11c23]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:15 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 Apr 28 04:55:15 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:15 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" returned: 0 in 0.755s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb83da1-4158-4b83-8aa7-7a138806b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac286e2c-3359-4c14-b0a0-6fa95fd0e631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Volume volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 (f1e42ab6-7f7b-49f8-9af8-260526dfdf12): created successfully Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac286e2c-3359-4c14-b0a0-6fa95fd0e631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (41332d26-c7d9-4dfc-827c-9e212e2134f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ec451370-0c6e-4ebf-bb5b-2b0ad48fe6b7 tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:55:15 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740" returned: 0 in 0.742s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:15 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740 Apr 28 04:55:15 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-f1e42ab6-7f7b-49f8-9af8-260526dfdf12-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "cinder-f1e42ab6-7f7b-49f8-9af8-260526dfdf12-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-quobyte-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e348fd0-e8a9-4ea7-b744-66e9f1c9a34a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:16 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 Apr 28 04:55:16 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:16 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8f17e415-a0cb-4fa2-9338-37db4ba51740" returned: 0 in 0.819s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-quobyte-8f17e415-a0cb-4fa2-9338-37db4ba51740" released by "delete_volume" :: held 1.608s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Created reservations ['5d81c6c9-c7cc-4427-95e3-9368f2a0e993', '03f14e01-305a-416c-969f-e52c5528d889', '1315f6f8-a8f7-44a5-acd2-374cf9439802', '7e1c4513-093b-4a9f-9579-5fcdd850aba1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:16 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:16 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Flow 'volume_create_manager' (816e5273-ab24-4028-bb66-4c0d3a0c53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b8795-0807-44d2-8f13-0db5021ecbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b8795-0807-44d2-8f13-0db5021ecbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-963478216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125dcbad-8818-4ff0-8089-4f9a6e36496a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6c7a912ecc4d959a3bc55c7a8554f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:17Z,use_quota=True,user_id='ef5b97c3256a4358824489c8eee9fefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811213c8-0fb2-4881-abbe-5fcdf65c1c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811213c8-0fb2-4881-abbe-5fcdf65c1c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:16 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf21f6c2-53c2-4cde-878e-14d5f0120718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf21f6c2-53c2-4cde-878e-14d5f0120718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125dcbad-8818-4ff0-8089-4f9a6e36496a', 'volume_name': 'volume-125dcbad-8818-4ff0-8089-4f9a6e36496a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df0754-8a90-4dd5-949f-b4f159262be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df0754-8a90-4dd5-949f-b4f159262be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd76fd93-06a6-49b6-b784-3ff55961537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Volume 125dcbad-8818-4ff0-8089-4f9a6e36496a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125dcbad-8818-4ff0-8089-4f9a6e36496a', 'volume_size': 1} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-963478216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125dcbad-8818-4ff0-8089-4f9a6e36496a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6c7a912ecc4d959a3bc55c7a8554f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:17Z,use_quota=True,user_id='ef5b97c3256a4358824489c8eee9fefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Creating volume 125dcbad-8818-4ff0-8089-4f9a6e36496a {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:17 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" returned: 0 in 0.714s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:17 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a 1073741824 Apr 28 04:55:17 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:17 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12 Apr 28 04:55:17 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:17 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:17 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Deleted volume successfully. Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a48f3776-f72a-441b-ba8c-badf124c8374 tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-8f17e415-a0cb-4fa2-9338-37db4ba51740-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Flow 'volume_create_manager' (a4343d5d-bab4-4902-9023-a24821959b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc241fdb-c4a8-4e86-8aa9-77b94d51320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc241fdb-c4a8-4e86-8aa9-77b94d51320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-912950647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b324e06-04a2-4c2d-91db-7e7c3d18a2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9091b01b004bc9aa37a08f4707d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:17Z,use_quota=True,user_id='e6c57c1ef94c49ce910feefc285d260f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d3f22f-8d08-4b81-b63f-20c345871b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d3f22f-8d08-4b81-b63f-20c345871b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:17 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6175daa4-bfd5-4695-a7e8-cbc4e3ea75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6175daa4-bfd5-4695-a7e8-cbc4e3ea75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b324e06-04a2-4c2d-91db-7e7c3d18a2ca', 'volume_name': 'volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85899c85-2002-45fd-b45f-c3d5441b8eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85899c85-2002-45fd-b45f-c3d5441b8eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b15caa-0f8d-4436-ae4a-425576c33ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:17 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Volume 1b324e06-04a2-4c2d-91db-7e7c3d18a2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca', 'volume_size': 1} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-f1e42ab6-7f7b-49f8-9af8-260526dfdf12" released by "delete_volume" :: held 1.329s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Created reservations ['8608ca14-0f28-4da6-b0a0-5d09f7accc41', 'e6a37789-9606-4f69-b6a5-d00c1d131f8c', 'fb9fddfe-f597-49c4-8215-cbca55dbdd87', 'ca12db19-7b0e-4ed5-91dc-14c685f4099e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:17 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:17 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:17 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a 1073741824" returned: 0 in 0.802s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:17 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a Apr 28 04:55:17 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:18 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.513s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Deleted volume successfully. Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d1d4f52d-aafa-4972-bb7b-6887b7e2d260 tempest-VolumesActionsTest-287659146 None] Lock "cinder-f1e42ab6-7f7b-49f8-9af8-260526dfdf12-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:18 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a" returned: 0 in 0.508s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-912950647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b324e06-04a2-4c2d-91db-7e7c3d18a2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9091b01b004bc9aa37a08f4707d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:17Z,use_quota=True,user_id='e6c57c1ef94c49ce910feefc285d260f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Creating volume 1b324e06-04a2-4c2d-91db-7e7c3d18a2ca {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:18 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:18 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca 1073741824 Apr 28 04:55:18 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd76fd93-06a6-49b6-b784-3ff55961537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125dcbad-8818-4ff0-8089-4f9a6e36496a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53560c7-cd9f-41a0-b8ae-78b7fb289fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Volume volume-125dcbad-8818-4ff0-8089-4f9a6e36496a (125dcbad-8818-4ff0-8089-4f9a6e36496a): created successfully Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53560c7-cd9f-41a0-b8ae-78b7fb289fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Flow 'volume_create_manager' (816e5273-ab24-4028-bb66-4c0d3a0c53e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f3af659c-0c33-4ec2-9aa2-60dfb7881622 tempest-VolumesNegativeTest-1979080190 None] Created volume successfully. Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (daf6e3fe-a0ec-4e74-819c-4802bf08c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf600c-7854-406b-9219-bf217d41e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf600c-7854-406b-9219-bf217d41e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421989683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73df9d-61c2-4450-88ce-ec4f54511e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:19Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e876e-24c3-4925-bc8a-09af5362a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e876e-24c3-4925-bc8a-09af5362a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039be58e-e598-4cf2-80b9-868d79fb82c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039be58e-e598-4cf2-80b9-868d79fb82c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc73df9d-61c2-4450-88ce-ec4f54511e20', 'volume_name': 'volume-cc73df9d-61c2-4450-88ce-ec4f54511e20', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be75f08-8923-45f5-9c21-8ede641470d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be75f08-8923-45f5-9c21-8ede641470d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a21b2f-8903-4b89-b1c1-b6f742cfa399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Volume cc73df9d-61c2-4450-88ce-ec4f54511e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc73df9d-61c2-4450-88ce-ec4f54511e20', 'volume_size': 1} Apr 28 04:55:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:19 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca 1073741824" returned: 0 in 0.752s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:19 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca Apr 28 04:55:19 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:19 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" returned: 0 in 0.588s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421989683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73df9d-61c2-4450-88ce-ec4f54511e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:19Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Creating volume cc73df9d-61c2-4450-88ce-ec4f54511e20 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:19 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b15caa-0f8d-4436-ae4a-425576c33ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:19 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 1073741824 Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d944a1a-d909-41b7-be02-307eb3af60ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:19 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:19 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Volume volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca (1b324e06-04a2-4c2d-91db-7e7c3d18a2ca): created successfully Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d944a1a-d909-41b7-be02-307eb3af60ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:19 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Flow 'volume_create_manager' (a4343d5d-bab4-4902-9023-a24821959b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1f170921-bae8-4b6f-ad96-7d76fab83b9b tempest-VolumesTransfersTest-164247234 None] Created volume successfully. Apr 28 04:55:20 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 1073741824" returned: 0 in 0.767s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:20 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 Apr 28 04:55:20 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "cinder-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:21 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20" returned: 0 in 0.533s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a21b2f-8903-4b89-b1c1-b6f742cfa399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc73df9d-61c2-4450-88ce-ec4f54511e20', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c4fffe-deeb-427c-9ec1-c795f84df1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "cinder-quobyte-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Volume volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 (cc73df9d-61c2-4450-88ce-ec4f54511e20): created successfully Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c4fffe-deeb-427c-9ec1-c795f84df1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (daf6e3fe-a0ec-4e74-819c-4802bf08c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-quobyte-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ca84e57b-276b-4504-9780-51d16135079d tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2a2079-86b0-4609-a60d-1c385407fb6f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:21 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca Apr 28 04:55:21 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:21 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" returned: 0 in 0.608s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:21 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca Apr 28 04:55:21 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-cc73df9d-61c2-4450-88ce-ec4f54511e20-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "cinder-cc73df9d-61c2-4450-88ce-ec4f54511e20-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Acquiring lock "cinder-quobyte-cc73df9d-61c2-4450-88ce-ec4f54511e20" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-cc73df9d-61c2-4450-88ce-ec4f54511e20" acquired by "delete_volume" :: waited 0.042s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e9913-4022-47c2-be3d-64f36b79464d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:22 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" returned: 0 in 0.834s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:22 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-quobyte-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca" released by "delete_volume" :: held 1.497s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:22 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Created reservations ['079e6b49-2797-443e-bc26-5ea63ef7b7dc', 'e2a8b998-958f-408e-90c6-ef8a5ad84a46', '644b16d4-18f8-4e28-b0bc-12b7e4959e77', '061e4b87-28a8-48ea-ab9c-91f5422197a4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:22 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:22 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:23 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20" returned: 0 in 0.824s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:23 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20 Apr 28 04:55:23 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:23 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.778s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:23 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:23 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Deleted volume successfully. Apr 28 04:55:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-40a6c880-de01-4eb7-87eb-ef705991fd8c tempest-VolumesTransfersTest-1475010064 None] Lock "cinder-1b324e06-04a2-4c2d-91db-7e7c3d18a2ca-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:24 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cc73df9d-61c2-4450-88ce-ec4f54511e20" returned: 0 in 0.778s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "cinder-quobyte-cc73df9d-61c2-4450-88ce-ec4f54511e20" released by "delete_volume" :: held 1.664s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Created reservations ['94856a86-843d-41be-b521-65588e3a348a', 'd69c075c-9017-47f8-a3c7-32d79a7cda87', '2a6e46b9-dbe3-4567-94ad-d27c0501ce46', '75fc0a58-4e22-4d31-a661-084156792b86'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:24 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:24 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:25 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.944s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Deleted volume successfully. Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2ae3ec33-b4d1-4689-a56c-3036273be5c1 tempest-VolumesActionsTest-287659146 None] Lock "cinder-cc73df9d-61c2-4450-88ce-ec4f54511e20-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (85b11a7f-ed9f-40b7-9557-cbce01d18a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f956055e-64a8-4eca-a24b-aedc3aeea007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f956055e-64a8-4eca-a24b-aedc3aeea007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148828597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ed2fa1-8b72-4d29-8a3b-2696eda689bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:26Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e505b-03d9-4ae4-8f9f-070cfe8f14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e505b-03d9-4ae4-8f9f-070cfe8f14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6491e221-b367-42fa-9723-198e5880a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6491e221-b367-42fa-9723-198e5880a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ed2fa1-8b72-4d29-8a3b-2696eda689bc', 'volume_name': 'volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f217a22-e4fc-4743-a0f1-23881340d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f217a22-e4fc-4743-a0f1-23881340d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35196552-b1b5-4336-b357-9af50de8cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Volume 69ed2fa1-8b72-4d29-8a3b-2696eda689bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc', 'volume_size': 1} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148828597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ed2fa1-8b72-4d29-8a3b-2696eda689bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36849c43da1413f81118bb733a60e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:26Z,use_quota=True,user_id='105d0076ece54f3da04907b8b3e67efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Creating volume 69ed2fa1-8b72-4d29-8a3b-2696eda689bc {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:25 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:25 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc 1073741824 Apr 28 04:55:25 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:26 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc 1073741824" returned: 0 in 1.035s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:26 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc Apr 28 04:55:26 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:27 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" returned: 0 in 0.777s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35196552-b1b5-4336-b357-9af50de8cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff31c7a-85ce-4e1d-9613-3266c211d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Volume volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc (69ed2fa1-8b72-4d29-8a3b-2696eda689bc): created successfully Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff31c7a-85ce-4e1d-9613-3266c211d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Flow 'volume_create_manager' (85b11a7f-ed9f-40b7-9557-cbce01d18a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-17709b1d-bc2f-4c81-9244-2890f1143670 tempest-VolumesActionsTest-398146747 None] Created volume successfully. Apr 28 04:55:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-69ed2fa1-8b72-4d29-8a3b-2696eda689bc-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "cinder-69ed2fa1-8b72-4d29-8a3b-2696eda689bc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Acquiring lock "cinder-quobyte-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "cinder-quobyte-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" acquired by "delete_volume" :: waited 0.033s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce130a5e-26a7-455a-bba1-4d036b6155f9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:30 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc Apr 28 04:55:30 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:30 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" returned: 0 in 0.754s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:30 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc Apr 28 04:55:30 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Flow 'volume_create_manager' (064bb713-e271-4fae-9f7f-337f60935161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b210d682-5afa-4116-a1dc-764a32d9eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b210d682-5afa-4116-a1dc-764a32d9eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277381564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c089e1-3208-46f9-a82d-8c272fd3ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f2a7bab69d4b518278a689b9a864da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:32Z,use_quota=True,user_id='0ac56919bbdd45a6b9fb5bab026cb236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7437dc5-55b9-4eef-9f14-910ff8ec2df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:31 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7437dc5-55b9-4eef-9f14-910ff8ec2df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aeb5bb-b036-4664-bd7e-f7fc98ecda83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aeb5bb-b036-4664-bd7e-f7fc98ecda83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c089e1-3208-46f9-a82d-8c272fd3ffc9', 'volume_name': 'volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9', 'volume_size': 2}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f94705-4a04-461a-9e58-6ba142368ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f94705-4a04-461a-9e58-6ba142368ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71563577-0e8a-4062-b3b2-fa418c2dd74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:31 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Volume a2c089e1-3208-46f9-a82d-8c272fd3ffc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9', 'volume_size': 2} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277381564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c089e1-3208-46f9-a82d-8c272fd3ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f2a7bab69d4b518278a689b9a864da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:32Z,use_quota=True,user_id='0ac56919bbdd45a6b9fb5bab026cb236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Creating volume a2c089e1-3208-46f9-a82d-8c272fd3ffc9 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:31 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 2147483648 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" returned: 0 in 1.008s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:31 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 2147483648 Apr 28 04:55:31 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "cinder-quobyte-69ed2fa1-8b72-4d29-8a3b-2696eda689bc" released by "delete_volume" :: held 1.820s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Created reservations ['87de68cb-4b20-4f77-b078-9b31e8bc402c', 'b66ad288-df25-4cd8-a78b-5d3078d92238', 'da8d5b31-7ca0-479a-96e0-d46b1d6974a0', 'f8a5bb42-1892-491b-83e4-3fc406b68fb3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:32 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:32 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:32 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 2147483648" returned: 0 in 0.840s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:32 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 Apr 28 04:55:32 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:32 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.892s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:32 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:32 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Deleted volume successfully. Apr 28 04:55:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cc44255c-12a0-4c6d-a1ec-6dbf58bb84d3 tempest-VolumesActionsTest-398146747 None] Lock "cinder-69ed2fa1-8b72-4d29-8a3b-2696eda689bc-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:33 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71563577-0e8a-4062-b3b2-fa418c2dd74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9', 'volume_size': 2}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abb7f29-f813-41fa-8b0f-b5e2d6836d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Volume volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 (a2c089e1-3208-46f9-a82d-8c272fd3ffc9): created successfully Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abb7f29-f813-41fa-8b0f-b5e2d6836d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Flow 'volume_create_manager' (064bb713-e271-4fae-9f7f-337f60935161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a47794cd-c20d-4caa-b3ae-def9e730c363 tempest-VolumesCloneNegativeTest-2039648160 None] Created volume successfully. Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Acquiring lock "cinder-a2c089e1-3208-46f9-a82d-8c272fd3ffc9-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "cinder-a2c089e1-3208-46f9-a82d-8c272fd3ffc9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Acquiring lock "cinder-quobyte-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "cinder-quobyte-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbc8b2-e385-4170-a98a-b52a169f395a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:34 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 Apr 28 04:55:34 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:35 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" returned: 0 in 0.894s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:35 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9 Apr 28 04:55:35 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:36 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" returned: 0 in 1.261s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "cinder-quobyte-a2c089e1-3208-46f9-a82d-8c272fd3ffc9" released by "delete_volume" :: held 2.215s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Created reservations ['26880143-3442-4863-883f-c8ec59f7c615', 'e4850723-e221-4585-9f34-8fa245f31b71', '8110b785-19b4-46e5-9e68-514c1786983e', '6af4dbff-8d46-4aa8-b601-ed784a7bc17d'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:36 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:36 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:37 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.672s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:37 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Deleted volume successfully. Apr 28 04:55:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b016996e-f34d-4b19-b143-0c9b7b77bca2 tempest-VolumesCloneNegativeTest-2039648160 None] Lock "cinder-a2c089e1-3208-46f9-a82d-8c272fd3ffc9-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (f5c036f7-57f0-4aa3-ba7a-f2f6d87c89c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822fd409-7d10-4aa8-921f-4f8ceb648821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822fd409-7d10-4aa8-921f-4f8ceb648821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969190050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73deef31-d238-46a8-b755-7ca11179b909,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:42Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aa4575-b720-4eac-a466-ddcaf5ea1634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aa4575-b720-4eac-a466-ddcaf5ea1634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c670ae-41d3-4a40-814f-6b40b7deff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c670ae-41d3-4a40-814f-6b40b7deff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73deef31-d238-46a8-b755-7ca11179b909', 'volume_name': 'volume-73deef31-d238-46a8-b755-7ca11179b909', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00740d3b-d41e-4b89-8f21-a9b370018bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00740d3b-d41e-4b89-8f21-a9b370018bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01afa6f7-88b4-49a7-97fe-e89669a664b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:41 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Volume 73deef31-d238-46a8-b755-7ca11179b909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73deef31-d238-46a8-b755-7ca11179b909', 'volume_size': 1} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969190050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73deef31-d238-46a8-b755-7ca11179b909,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:42Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Creating volume 73deef31-d238-46a8-b755-7ca11179b909 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:41 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:41 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 1073741824 Apr 28 04:55:41 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:42 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 1073741824" returned: 0 in 0.940s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:42 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 Apr 28 04:55:42 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:43 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909" returned: 0 in 0.662s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01afa6f7-88b4-49a7-97fe-e89669a664b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73deef31-d238-46a8-b755-7ca11179b909', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1cf000-b5d3-4861-a4b6-7b48035373b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:43 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Volume volume-73deef31-d238-46a8-b755-7ca11179b909 (73deef31-d238-46a8-b755-7ca11179b909): created successfully Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1cf000-b5d3-4861-a4b6-7b48035373b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (f5c036f7-57f0-4aa3-ba7a-f2f6d87c89c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6dff552d-c202-47e8-8096-09ca9c9dd5d1 tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (c6fcb445-7749-402a-8fb1-7dbfca3b8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d402405-29ff-44bb-adb7-ac37e2c5daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d402405-29ff-44bb-adb7-ac37e2c5daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-920369307',display_name='tempest-VolumesGetTest-Volume-19952489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:45Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f2812-3e5e-4619-98b0-58d3463375f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f2812-3e5e-4619-98b0-58d3463375f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda9c11-b7c8-4cda-9217-a535b2c56a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda9c11-b7c8-4cda-9217-a535b2c56a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5', 'volume_name': 'volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20f5248-0a36-403b-aa8b-d94f377042e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20f5248-0a36-403b-aa8b-d94f377042e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cdf160-edb4-4684-a92d-9aa7b55fbbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:45 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Volume a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5', 'volume_size': 1} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-920369307',display_name='tempest-VolumesGetTest-Volume-19952489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:45Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Creating volume a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:45 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:45 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 1073741824 Apr 28 04:55:45 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:46 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 1073741824" returned: 0 in 1.009s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:46 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 Apr 28 04:55:46 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:46 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" returned: 0 in 0.714s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cdf160-edb4-4684-a92d-9aa7b55fbbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089b246b-d360-4c25-9a1a-1666d60d2faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Volume volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 (a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5): created successfully Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089b246b-d360-4c25-9a1a-1666d60d2faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (c6fcb445-7749-402a-8fb1-7dbfca3b8a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-be0ec0e8-9596-4615-aa3d-a845ac70b1c0 tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "cinder-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a6312f-975b-419c-a900-ce71e71ec521]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:47 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 Apr 28 04:55:47 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:48 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" returned: 0 in 0.812s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:48 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5 Apr 28 04:55:48 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Flow 'volume_create_manager' (3155b983-4d7b-4ce8-8628-dd42a5a83dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3342c33f-5738-4e44-8f09-f48f05db540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3342c33f-5738-4e44-8f09-f48f05db540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1759533455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ef429c-ae16-49f9-a764-c506ea259c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41c801d57084242a4f4f2cee76beb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:49Z,use_quota=True,user_id='2acd336824c24341973ad380abb06631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b22a6f0-e92d-4d14-96a1-8ced680bf5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b22a6f0-e92d-4d14-96a1-8ced680bf5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6acb0eb-d3ed-40c6-9294-0d17f854bd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6acb0eb-d3ed-40c6-9294-0d17f854bd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ef429c-ae16-49f9-a764-c506ea259c72', 'volume_name': 'volume-19ef429c-ae16-49f9-a764-c506ea259c72', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c36c0-2752-4580-b46d-2622dff6a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c36c0-2752-4580-b46d-2622dff6a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbed29-097f-400f-94df-d2bf7b486fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:49 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Volume 19ef429c-ae16-49f9-a764-c506ea259c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ef429c-ae16-49f9-a764-c506ea259c72', 'volume_size': 1} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1759533455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ef429c-ae16-49f9-a764-c506ea259c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41c801d57084242a4f4f2cee76beb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:49Z,use_quota=True,user_id='2acd336824c24341973ad380abb06631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Creating volume 19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:49 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:49 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 1073741824 Apr 28 04:55:49 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:49 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" returned: 0 in 0.546s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5" released by "delete_volume" :: held 1.447s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Created reservations ['39cda774-b0c6-40f6-9cc2-f436973c69e3', 'a6d0b2e2-b645-4ccf-9c38-020630ff396c', '3d2a2901-18ce-4f4d-9385-10bbe7deae8d', '8557ef74-3546-4964-85c7-47ed4bf85651'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:49 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:49 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:49 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.583s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-73deef31-d238-46a8-b755-7ca11179b909-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "cinder-73deef31-d238-46a8-b755-7ca11179b909-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e31dce5e-40f5-4089-a540-7d4c9ba8b231 tempest-VolumesGetTest-994103817 None] Lock "cinder-a17fb3e9-7f0d-4d0e-a651-0d5c5ebd70f5-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-73deef31-d238-46a8-b755-7ca11179b909" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-73deef31-d238-46a8-b755-7ca11179b909" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:50 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 1073741824" returned: 0 in 1.074s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6707db29-7d76-419a-87ff-501652402276]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:50 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 Apr 28 04:55:50 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:50 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 Apr 28 04:55:50 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:50 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72" returned: 0 in 0.586s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbed29-097f-400f-94df-d2bf7b486fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ef429c-ae16-49f9-a764-c506ea259c72', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84c6c2a-d63f-4dcc-8edf-218f81523d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:50 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Volume volume-19ef429c-ae16-49f9-a764-c506ea259c72 (19ef429c-ae16-49f9-a764-c506ea259c72): created successfully Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84c6c2a-d63f-4dcc-8edf-218f81523d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Flow 'volume_create_manager' (3155b983-4d7b-4ce8-8628-dd42a5a83dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:50 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-12137fcb-43a4-41f9-b519-74095b4925ef tempest-SnapshotMetadataTestJSON-1161177262 None] Created volume successfully. Apr 28 04:55:50 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909" returned: 0 in 0.810s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:50 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909 Apr 28 04:55:50 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Creating offline snapshot 69f59522-6e2e-4898-aa12-06de44c52b04 of volume 19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad025d-f631-4130-a936-54b589bcf0ef]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:51 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-73deef31-d238-46a8-b755-7ca11179b909" returned: 0 in 0.906s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-73deef31-d238-46a8-b755-7ca11179b909" released by "delete_volume" :: held 1.772s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:51 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 Apr 28 04:55:51 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:51 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Created reservations ['d08deded-b5f1-429e-9881-a87054e6d010', '6f61ed87-b777-4272-bb4a-04eaafd27e99', 'a2760958-8c83-46e7-85c4-83ad3e7db911', 'c89066a5-2f1d-4034-a89b-2b1079be6504'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:52 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:52 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:52 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72" returned: 0 in 0.914s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:52 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 1G Apr 28 04:55:52 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:52 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (bfb156d4-3a32-4278-b088-94614fca994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078e309-dcb1-462c-b301-efb06dfe48d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.954s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:53 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078e309-dcb1-462c-b301-efb06dfe48d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1244867342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d079356d-4332-43db-ac98-ef2bfe14755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:53Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c85844-8903-4595-bc37-23e8b256ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c85844-8903-4595-bc37-23e8b256ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688a8bbe-34c7-44e1-b9af-ee08030b65b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688a8bbe-34c7-44e1-b9af-ee08030b65b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd079356d-4332-43db-ac98-ef2bfe14755c', 'volume_name': 'volume-d079356d-4332-43db-ac98-ef2bfe14755c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a8c07-f923-4dec-a18e-227da5198af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a8c07-f923-4dec-a18e-227da5198af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3101232a-9db8-4a1e-bae3-a26857706fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:53 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Volume d079356d-4332-43db-ac98-ef2bfe14755c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d079356d-4332-43db-ac98-ef2bfe14755c', 'volume_size': 1} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3e8d6448-ce6b-4097-9a14-2d2e3628077d tempest-VolumesGetTest-994103817 None] Lock "cinder-73deef31-d238-46a8-b755-7ca11179b909-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:53 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 1G" returned: 0 in 1.139s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ef429c-ae16-49f9-a764-c506ea259c72 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:53 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ef429c-ae16-49f9-a764-c506ea259c72 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 Apr 28 04:55:53 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:54 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ef429c-ae16-49f9-a764-c506ea259c72 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:54 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 is being set with open permissions: ugo+rw Apr 28 04:55:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:54 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 Apr 28 04:55:54 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:55 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04" returned: 0 in 0.670s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:55 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info Apr 28 04:55:55 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:55 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info" returned: 0 in 0.490s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:55 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info is being set with open permissions: ugo+rw Apr 28 04:55:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:55 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info Apr 28 04:55:55 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:56 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.info" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.508s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.037s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1244867342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d079356d-4332-43db-ac98-ef2bfe14755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:53Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Creating volume d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:55:56 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:56 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c 1073741824 Apr 28 04:55:56 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:56 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0d7058b3-2e82-4e08-a120-7eaeed7bfff0 tempest-SnapshotMetadataTestJSON-1161177262 None] Create snapshot completed successfully Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:56 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:56 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:56 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c 1073741824" returned: 0 in 0.667s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:56 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:55:56 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:57 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.737s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:55:57 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.694s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3101232a-9db8-4a1e-bae3-a26857706fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d079356d-4332-43db-ac98-ef2bfe14755c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e734f0a9-8fad-4e0a-8116-6b0aee8680b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Volume volume-d079356d-4332-43db-ac98-ef2bfe14755c (d079356d-4332-43db-ac98-ef2bfe14755c): created successfully Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e734f0a9-8fad-4e0a-8116-6b0aee8680b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (bfb156d4-3a32-4278-b088-94614fca994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:57 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a48df5e8-f6db-405b-8c22-9d29d7c7850d tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "cinder-69f59522-6e2e-4898-aa12-06de44c52b04-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-69f59522-6e2e-4898-aa12-06de44c52b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "cinder-quobyte-69f59522-6e2e-4898-aa12-06de44c52b04" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-69f59522-6e2e-4898-aa12-06de44c52b04" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Deleting offline snapshot 69f59522-6e2e-4898-aa12-06de44c52b04 of volume 19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] snapshot_file for this snap is: volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Acquiring lock "cinder-125dcbad-8818-4ff0-8089-4f9a6e36496a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe0ef7-c718-4631-ae43-84c049edc9d3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "cinder-125dcbad-8818-4ff0-8089-4f9a6e36496a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Acquiring lock "cinder-quobyte-125dcbad-8818-4ff0-8089-4f9a6e36496a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "cinder-quobyte-125dcbad-8818-4ff0-8089-4f9a6e36496a" acquired by "delete_volume" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:55:58 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 Apr 28 04:55:58 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1313807-4536-4178-a658-f98f0c4edaf7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:58 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a Apr 28 04:55:58 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:58 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04" returned: 0 in 0.677s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ef429c-ae16-49f9-a764-c506ea259c72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0bd77-28ed-4d32-91ef-dd1a30951e13]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:58 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 Apr 28 04:55:58 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:58 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a" returned: 0 in 0.794s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:59 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a Apr 28 04:55:59 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (0bb738ce-d9f4-4474-9d20-076cdf935723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd08c09-9143-4ead-80e0-10abe5caa761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd08c09-9143-4ead-80e0-10abe5caa761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1398112054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dae4f74-51d1-4459-a5ef-fecbe464b31e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d079356d-4332-43db-ac98-ef2bfe14755c,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:59Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42eddf6d-acc8-450d-beb2-2e6fb3049a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42eddf6d-acc8-450d-beb2-2e6fb3049a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237f8467-0f9d-4339-8a9c-be2eddf764f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237f8467-0f9d-4339-8a9c-be2eddf764f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6dae4f74-51d1-4459-a5ef-fecbe464b31e', 'volume_name': 'volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e', 'volume_size': 1, 'source_volid': 'd079356d-4332-43db-ac98-ef2bfe14755c', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0135fb3-fc6a-4266-9fe8-2475af370e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0135fb3-fc6a-4266-9fe8-2475af370e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7eb1a2-8aec-4fcc-8e70-e01a0c8c0ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Volume 6dae4f74-51d1-4459-a5ef-fecbe464b31e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e', 'volume_size': 1, 'source_volid': 'd079356d-4332-43db-ac98-ef2bfe14755c', 'source_volstatus': 'available'} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Flow 'volume_create_manager' (13312c3e-2a5b-4f45-ae2b-b511315194d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf727a9-6a69-47ce-8865-5f20e05772fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:59 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Cloning volume d079356d-4332-43db-ac98-ef2bfe14755c to volume 6dae4f74-51d1-4459-a5ef-fecbe464b31e Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf727a9-6a69-47ce-8865-5f20e05772fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1229768160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e33fb7-3938-4fb8-b357-8e6ace5330a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3f0a524b64d708f2c3c04da0c6881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:59Z,use_quota=True,user_id='fb38a395da274ab2af3b64edb726bbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc99efbc-d297-4390-b620-34fb62be3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc99efbc-d297-4390-b620-34fb62be3247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc5d5a9-59ac-48dc-8c8e-c2c4b85427ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc5d5a9-59ac-48dc-8c8e-c2c4b85427ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e33fb7-3938-4fb8-b357-8e6ace5330a0', 'volume_name': 'volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3c8e5d-ad00-4fe0-a971-d9e7d41cac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3c8e5d-ad00-4fe0-a971-d9e7d41cac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e69df05-582f-4587-afbb-dee9a7d2b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:55:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Volume 60e33fb7-3938-4fb8-b357-8e6ace5330a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0', 'volume_size': 1} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Creating offline snapshot 85beac08-92db-444a-8774-88917cb7bf2f of volume d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4cc35-e389-4ace-af31-51d29e046c32]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:59 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:55:59 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:59 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-125dcbad-8818-4ff0-8089-4f9a6e36496a" returned: 0 in 0.589s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "cinder-quobyte-125dcbad-8818-4ff0-8089-4f9a6e36496a" released by "delete_volume" :: held 1.423s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:55:59 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72" returned: 0 in 0.795s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:59 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 Apr 28 04:55:59 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Created reservations ['4b3e0dc2-114e-47df-8d4c-0f8ffa3d573f', 'd5fff77e-9bad-415f-912f-5f5aad0859b9', 'e157a7d0-9dc1-4db4-a805-2cb13bdf4e0f', 'e04ab30c-13f1-4992-89da-8a84f33d67df'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:55:59 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:55:59 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:55:59 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:55:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:00 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f 1G Apr 28 04:56:00 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:00 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.517s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Deleted volume successfully. Apr 28 04:56:00 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04" returned: 0 in 0.655s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:00 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04 Apr 28 04:56:00 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b1c3588-b350-4643-b403-10bbc1c43482 tempest-VolumesNegativeTest-1979080190 None] Lock "cinder-125dcbad-8818-4ff0-8089-4f9a6e36496a-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:00 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f 1G" returned: 0 in 0.761s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d079356d-4332-43db-ac98-ef2bfe14755c -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:00 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d079356d-4332-43db-ac98-ef2bfe14755c -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:00 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:00 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72.69f59522-6e2e-4898-aa12-06de44c52b04" returned: 0 in 0.577s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-69f59522-6e2e-4898-aa12-06de44c52b04" released by "_delete_snapshot" :: held 2.851s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" released by "delete_snapshot" :: held 2.875s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:00 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Created reservations ['ea82adf1-7b80-41ba-94ac-f3fcde922f3f', '2508e307-a886-4c50-ab6b-f052a8f41ed5', '74a38bb9-b002-4194-8aaf-f7903d1b88c9', 'cb49016d-78fd-4831-aa02-8b7079656db1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:01 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Delete snapshot completed successfully. Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0d6fd7ef-d71e-4cbd-a909-0803dc7251ab tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-69f59522-6e2e-4898-aa12-06de44c52b04-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "cinder-19ef429c-ae16-49f9-a764-c506ea259c72-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-19ef429c-ae16-49f9-a764-c506ea259c72-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:01 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" acquired by "delete_volume" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d079356d-4332-43db-ac98-ef2bfe14755c -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.697s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:01 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f is being set with open permissions: ugo+rw Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a70536-bd2d-49e7-ad2f-bb608e81cb53]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:01 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:01 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:01 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 Apr 28 04:56:01 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:01 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.495s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:01 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info Apr 28 04:56:01 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:02 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72" returned: 0 in 0.630s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:02 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72 Apr 28 04:56:02 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:02 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:02 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info is being set with open permissions: ugo+rw Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:02 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info Apr 28 04:56:02 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:02 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-19ef429c-ae16-49f9-a764-c506ea259c72" returned: 0 in 0.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-quobyte-19ef429c-ae16-49f9-a764-c506ea259c72" released by "delete_volume" :: held 1.266s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Created reservations ['8dee7ade-7f0b-4af0-a38a-f2408cd0ed5c', 'f87aa83a-5342-4b14-b37e-8db22506b7aa', '0d386991-5898-4a2e-a58a-ddc43df60f93', 'a1f3e85d-2979-4e19-a0e2-3dcadaa449b1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:02 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:02 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (d33d1231-5ff6-4288-99f5-981bfed91c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c243e2-c2c3-4a86-a4bc-cac8517ce050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:02 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c243e2-c2c3-4a86-a4bc-cac8517ce050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549407047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d06b7-46ff-497d-a507-913954f4640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:03Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd08380b-038a-4766-8e9b-57732cf04f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd08380b-038a-4766-8e9b-57732cf04f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a06ab3-9e55-4f11-ac7e-fc9b5fc0dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a06ab3-9e55-4f11-ac7e-fc9b5fc0dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85d06b7-46ff-497d-a507-913954f4640b', 'volume_name': 'volume-a85d06b7-46ff-497d-a507-913954f4640b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e966bf-ee2f-4a3a-8493-81f230d4f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e966bf-ee2f-4a3a-8493-81f230d4f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8b952-a489-48ed-9bd6-c3684d29dad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:03 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume a85d06b7-46ff-497d-a507-913954f4640b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85d06b7-46ff-497d-a507-913954f4640b', 'volume_size': 1} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.info" returned: 0 in 0.498s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] snapshot: 85beac08-92db-444a-8774-88917cb7bf2f, volume: 6dae4f74-51d1-4459-a5ef-fecbe464b31e, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[431931fd-1d16-447e-8232-aa305dcca64b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:03 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:03 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:03 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.489s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:03 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Deleted volume successfully. Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3a0654f8-1b6b-46d2-a80c-7f8642edadd2 tempest-SnapshotMetadataTestJSON-1161177262 None] Lock "cinder-19ef429c-ae16-49f9-a764-c506ea259c72-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:03 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.545s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d079356d-4332-43db-ac98-ef2bfe14755c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c847bd5-d92d-4708-8744-5852b4fb40a5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:03 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:56:03 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:04 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.589s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:04 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:56:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:04 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e Apr 28 04:56:04 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:10 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e" returned: 0 in 5.747s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a651a58-6a21-482d-9d0f-efbeaaeaf93d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:10 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:56:10 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:10 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.676s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:56:10 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Converted 1024.00 MB image at 178.12 MB/s Apr 28 04:56:10 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e is being set with open permissions: ugo+rw Apr 28 04:56:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:10 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e Apr 28 04:56:10 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:11 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e" returned: 0 in 0.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" released by "_copy_volume_from_snapshot" :: held 8.096s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-85beac08-92db-444a-8774-88917cb7bf2f" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-85beac08-92db-444a-8774-88917cb7bf2f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Deleting offline snapshot 85beac08-92db-444a-8774-88917cb7bf2f of volume d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] snapshot_file for this snap is: volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b816c60-ede5-41c2-8ac3-1175ddbd8d90]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:11 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:11 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=100,cinder:INSERT=38,cinder:UPDATE=154,cinder:DELETE=16 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:11 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Flow 'volume_create_manager' (04d05c1f-28e5-4441-b233-da461a6ef7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09c235-5e3d-4cf7-aa57-86240a442f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.589s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d079356d-4332-43db-ac98-ef2bfe14755c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09c235-5e3d-4cf7-aa57-86240a442f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1087308981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13036d73-96c3-4ebc-9aed-ff5dcb189507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b61e0df28e4e69805eb5d580668d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:12Z,use_quota=True,user_id='4fda2fcc1c01483d88cff10e2feb7bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2592bfee-741f-48ba-9c48-26d939c81562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2592bfee-741f-48ba-9c48-26d939c81562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70699b0-6c04-48e3-bcc2-2dca85040230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70699b0-6c04-48e3-bcc2-2dca85040230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13036d73-96c3-4ebc-9aed-ff5dcb189507', 'volume_name': 'volume-13036d73-96c3-4ebc-9aed-ff5dcb189507', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35be50e-516b-44a7-9fbc-64130d8854f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35be50e-516b-44a7-9fbc-64130d8854f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804eae2-dde7-4357-b64c-a45d41c4409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:11 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Volume 13036d73-96c3-4ebc-9aed-ff5dcb189507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13036d73-96c3-4ebc-9aed-ff5dcb189507', 'volume_size': 1} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a0eb6-6d69-4d19-b6ec-2bfc5192699a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:11 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:56:11 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:12 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.522s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:12 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:12 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:12 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:12 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f Apr 28 04:56:12 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:13 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c.85beac08-92db-444a-8774-88917cb7bf2f" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-85beac08-92db-444a-8774-88917cb7bf2f" released by "_delete_snapshot" :: held 2.210s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=96,cinder:INSERT=29,cinder:UPDATE=128,cinder:DELETE=7 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.126s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.076s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1229768160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e33fb7-3938-4fb8-b357-8e6ace5330a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3f0a524b64d708f2c3c04da0c6881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:55:59Z,use_quota=True,user_id='fb38a395da274ab2af3b64edb726bbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Creating volume 60e33fb7-3938-4fb8-b357-8e6ace5330a0 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:13 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:13 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 1073741824 Apr 28 04:56:13 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7eb1a2-8aec-4fcc-8e70-e01a0c8c0ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e', 'volume_size': 1, 'source_volid': 'd079356d-4332-43db-ac98-ef2bfe14755c', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475364e8-71b7-4c53-abdf-4af62c396761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:13 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Volume volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e (6dae4f74-51d1-4459-a5ef-fecbe464b31e): created successfully Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475364e8-71b7-4c53-abdf-4af62c396761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (0bb738ce-d9f4-4474-9d20-076cdf935723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f0be3c79-a3c2-4418-8307-177d6cc962e6 tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:56:14 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 1073741824" returned: 0 in 0.616s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:14 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 Apr 28 04:56:14 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:14 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0" returned: 0 in 0.444s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.513s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549407047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d06b7-46ff-497d-a507-913954f4640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:03Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:14 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:14 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b 1073741824 Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e69df05-582f-4587-afbb-dee9a7d2b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61af9836-b4ba-4bb4-9fd7-d1eb57a6bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Volume volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 (60e33fb7-3938-4fb8-b357-8e6ace5330a0): created successfully Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61af9836-b4ba-4bb4-9fd7-d1eb57a6bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Flow 'volume_create_manager' (13312c3e-2a5b-4f45-ae2b-b511315194d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-745656bc-5e24-4353-ad77-f89b9f4b724c tempest-ServersNegativeTestJSON-498337351 None] Created volume successfully. Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (a115b0db-89ea-4143-87b0-10353aa288e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de4ed25-63e1-4ddc-bbfc-7e9d6d231e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de4ed25-63e1-4ddc-bbfc-7e9d6d231e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354343650',display_name='tempest-VolumesGetTest-Volume-1592289128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b618bd6c-74e2-4c03-811d-f72573306a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:15Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be7ce62-4216-4285-8849-0e6bf128ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be7ce62-4216-4285-8849-0e6bf128ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb4f57d-4490-43f8-8882-8590afaf0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb4f57d-4490-43f8-8882-8590afaf0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b618bd6c-74e2-4c03-811d-f72573306a7f', 'volume_name': 'volume-b618bd6c-74e2-4c03-811d-f72573306a7f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c89c18-1dbc-4cce-8549-062d0c6a5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c89c18-1dbc-4cce-8549-062d0c6a5382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06d479d-a4ef-474b-84ee-11443d952632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:14 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Volume b618bd6c-74e2-4c03-811d-f72573306a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b618bd6c-74e2-4c03-811d-f72573306a7f', 'volume_size': 1} Apr 28 04:56:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:15 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b 1073741824" returned: 0 in 0.638s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:15 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b Apr 28 04:56:15 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:15 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b" returned: 0 in 0.426s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.771s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1087308981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13036d73-96c3-4ebc-9aed-ff5dcb189507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b61e0df28e4e69805eb5d580668d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:12Z,use_quota=True,user_id='4fda2fcc1c01483d88cff10e2feb7bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Creating volume 13036d73-96c3-4ebc-9aed-ff5dcb189507 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:15 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:15 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 1073741824 Apr 28 04:56:15 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8b952-a489-48ed-9bd6-c3684d29dad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85d06b7-46ff-497d-a507-913954f4640b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d886974a-838c-4137-ba7a-544c9b1af37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-a85d06b7-46ff-497d-a507-913954f4640b (a85d06b7-46ff-497d-a507-913954f4640b): created successfully Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d886974a-838c-4137-ba7a-544c9b1af37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (d33d1231-5ff6-4288-99f5-981bfed91c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7f71a550-9262-467c-b3b4-24a9a01711f9 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:16 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 1073741824" returned: 0 in 0.751s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:16 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 Apr 28 04:56:16 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Flow 'volume_create_manager' (982518b1-cb25-447d-b42e-bb6b08b383f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2092f45c-74c6-4311-8f5d-bdb44fc942a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2092f45c-74c6-4311-8f5d-bdb44fc942a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2023147830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2caeacc-8626-4b17-9813-7601d58dc6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3f0a524b64d708f2c3c04da0c6881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:16Z,use_quota=True,user_id='fb38a395da274ab2af3b64edb726bbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0343eaf2-b642-43a1-9899-b6fab624ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0343eaf2-b642-43a1-9899-b6fab624ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c63d7b-3675-43d5-ad86-62ad94935b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c63d7b-3675-43d5-ad86-62ad94935b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2caeacc-8626-4b17-9813-7601d58dc6d8', 'volume_name': 'volume-c2caeacc-8626-4b17-9813-7601d58dc6d8', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cfdee2-ab1e-4230-992f-8ed3648ca89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cfdee2-ab1e-4230-992f-8ed3648ca89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dcc8a0-c86b-4037-863d-ec737b38e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Volume c2caeacc-8626-4b17-9813-7601d58dc6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2caeacc-8626-4b17-9813-7601d58dc6d8', 'volume_size': 1} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:16 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507" returned: 0 in 0.430s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.996s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354343650',display_name='tempest-VolumesGetTest-Volume-1592289128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b618bd6c-74e2-4c03-811d-f72573306a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:15Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Creating volume b618bd6c-74e2-4c03-811d-f72573306a7f {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:16 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:16 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f 1073741824 Apr 28 04:56:16 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804eae2-dde7-4357-b64c-a45d41c4409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13036d73-96c3-4ebc-9aed-ff5dcb189507', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db736a1-5bdf-476d-920d-9029dbfb831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Volume volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 (13036d73-96c3-4ebc-9aed-ff5dcb189507): created successfully Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db736a1-5bdf-476d-920d-9029dbfb831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Flow 'volume_create_manager' (04d05c1f-28e5-4441-b233-da461a6ef7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3c54cbfb-a38a-4e65-9f44-c8299895c012 tempest-AbsoluteLimitsTests-784658288 None] Created volume successfully. Apr 28 04:56:17 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f 1073741824" returned: 0 in 0.605s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:17 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f Apr 28 04:56:17 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:17 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f" returned: 0 in 0.423s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.592s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating offline snapshot 9eb2fb84-080a-4b43-bd56-09fc69c4cfee of volume a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06d479d-a4ef-474b-84ee-11443d952632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b618bd6c-74e2-4c03-811d-f72573306a7f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb85fc51-6dc4-4904-95ec-6b5a30ec0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f99d75-9fcb-454e-86e6-95b6bb3d7e49]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Volume volume-b618bd6c-74e2-4c03-811d-f72573306a7f (b618bd6c-74e2-4c03-811d-f72573306a7f): created successfully Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb85fc51-6dc4-4904-95ec-6b5a30ec0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (a115b0db-89ea-4143-87b0-10353aa288e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-06701e49-edc0-4939-8fcf-d6f25ff01198 tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:56:18 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b Apr 28 04:56:18 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Acquiring lock "cinder-13036d73-96c3-4ebc-9aed-ff5dcb189507-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "cinder-13036d73-96c3-4ebc-9aed-ff5dcb189507-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Acquiring lock "cinder-quobyte-13036d73-96c3-4ebc-9aed-ff5dcb189507" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "cinder-quobyte-13036d73-96c3-4ebc-9aed-ff5dcb189507" acquired by "delete_volume" :: waited 0.036s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c6797-ef0d-41dc-93df-5c9ad71dcbbd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:18 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 Apr 28 04:56:18 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:18 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b" returned: 0 in 0.594s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:18 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee 1G Apr 28 04:56:18 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:18 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507" returned: 0 in 0.535s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:18 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507 Apr 28 04:56:18 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-b618bd6c-74e2-4c03-811d-f72573306a7f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "cinder-b618bd6c-74e2-4c03-811d-f72573306a7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-b618bd6c-74e2-4c03-811d-f72573306a7f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-b618bd6c-74e2-4c03-811d-f72573306a7f" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:19 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13036d73-96c3-4ebc-9aed-ff5dcb189507" returned: 0 in 0.458s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232b891-cee8-4b9b-8a4d-bf5148891f09]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:19 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee 1G" returned: 0 in 0.744s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d06b7-46ff-497d-a507-913954f4640b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "cinder-quobyte-13036d73-96c3-4ebc-9aed-ff5dcb189507" released by "delete_volume" :: held 1.057s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:19 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d06b7-46ff-497d-a507-913954f4640b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee Apr 28 04:56:19 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Created reservations ['e9e49cbc-2eda-47bc-aa44-c856318adeed', '95459d33-8245-4e09-b374-09209ae22dff', '1fbc1ab8-1691-4b6f-bbfe-5cd9b9eced8a', 'db39fda2-9c3b-430b-8c22-e7a9ec7b21ea'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:19 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f Apr 28 04:56:19 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:19 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:19 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d06b7-46ff-497d-a507-913954f4640b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee" returned: 0 in 0.564s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:19 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee is being set with open permissions: ugo+rw Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:19 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee Apr 28 04:56:19 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:19 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.477s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f" returned: 0 in 0.629s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Deleted volume successfully. Apr 28 04:56:19 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f Apr 28 04:56:19 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-52d2f0ca-2af1-4011-a313-77423918a3f5 tempest-AbsoluteLimitsTests-784658288 None] Lock "cinder-13036d73-96c3-4ebc-9aed-ff5dcb189507-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:20 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:20 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b618bd6c-74e2-4c03-811d-f72573306a7f" returned: 0 in 0.495s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:20 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info Apr 28 04:56:20 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-b618bd6c-74e2-4c03-811d-f72573306a7f" released by "delete_volume" :: held 1.174s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Created reservations ['43d35c95-e071-4f61-9190-848884eeacc2', '8a118e44-dccd-4493-b8c7-5199a9902154', '1e5be08b-86fe-4cbf-8049-e99eeb02acbf', '919e174c-db82-4c22-a93c-4d9b6f220dcc'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:20 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:20 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:20 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:20 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info is being set with open permissions: ugo+rw Apr 28 04:56:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:21 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info Apr 28 04:56:21 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:21 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.497s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b3845151-e3ae-4841-9efd-47d2277e77de tempest-VolumesGetTest-994103817 None] Lock "cinder-b618bd6c-74e2-4c03-811d-f72573306a7f-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-6dae4f74-51d1-4459-a5ef-fecbe464b31e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "cinder-6dae4f74-51d1-4459-a5ef-fecbe464b31e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:21 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.info" returned: 0 in 0.589s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.646s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.004s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2023147830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2caeacc-8626-4b17-9813-7601d58dc6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3f0a524b64d708f2c3c04da0c6881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:16Z,use_quota=True,user_id='fb38a395da274ab2af3b64edb726bbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Creating volume c2caeacc-8626-4b17-9813-7601d58dc6d8 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:21 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:21 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 1073741824 Apr 28 04:56:21 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f8aa994e-966d-4e75-9807-7e8aac75dfa7 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Create snapshot completed successfully Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d4a2bc-b855-4cb0-ac95-38a0d54ced46]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:21 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e Apr 28 04:56:21 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:22 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 1073741824" returned: 0 in 0.772s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:22 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e" returned: 0 in 0.753s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:22 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 Apr 28 04:56:22 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:22 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e Apr 28 04:56:22 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:23 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8" returned: 0 in 0.634s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dcc8a0-c86b-4037-863d-ec737b38e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2caeacc-8626-4b17-9813-7601d58dc6d8', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c5831a-d8c7-4393-8eae-407d93c4956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-6dae4f74-51d1-4459-a5ef-fecbe464b31e" returned: 0 in 0.671s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:23 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Volume volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 (c2caeacc-8626-4b17-9813-7601d58dc6d8): created successfully Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c5831a-d8c7-4393-8eae-407d93c4956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Flow 'volume_create_manager' (982518b1-cb25-447d-b42e-bb6b08b383f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-6dae4f74-51d1-4459-a5ef-fecbe464b31e" released by "delete_volume" :: held 1.500s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (3eb5fe53-ec7c-430c-8a7c-f1c2e364c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea0cc5e-04c6-43d8-a896-6142389c157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b1638a0d-8a3e-42cf-bab2-3c3aef6031c6 tempest-ServersNegativeTestJSON-498337351 None] Created volume successfully. Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea0cc5e-04c6-43d8-a896-6142389c157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184877022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2e2adc-1b96-4429-8efb-110ea53ba13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:23Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13129fe-91f6-4f7c-be4f-3b146d62277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13129fe-91f6-4f7c-be4f-3b146d62277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c9894f-3d35-4465-a0e3-b70f64890c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c9894f-3d35-4465-a0e3-b70f64890c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2e2adc-1b96-4429-8efb-110ea53ba13f', 'volume_name': 'volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d7434d-0a4a-468c-8a79-1235fa33f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d7434d-0a4a-468c-8a79-1235fa33f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a979afc9-e517-477b-b150-d8d09689541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume dc2e2adc-1b96-4429-8efb-110ea53ba13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f', 'volume_size': 1} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184877022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2e2adc-1b96-4429-8efb-110ea53ba13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:23Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume dc2e2adc-1b96-4429-8efb-110ea53ba13f {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:23 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Created reservations ['4f97e785-667b-434d-aa53-0609811591d5', '416782ba-3d5d-4db7-8b1d-5fc5af355aa3', '85c2661c-a2bc-4020-9472-8fad0f73e902', '7bd3f2e4-3d78-4c3c-a704-6220d817b5f4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:23 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f 1073741824 Apr 28 04:56:23 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:23 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:23 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (93616a2f-cd3f-4a8c-8458-99aa781db893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1300db0-d49d-4833-9fe6-0a717da73865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1300db0-d49d-4833-9fe6-0a717da73865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932984325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:23Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40fac38-b9be-4934-b914-a9eeb34923f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40fac38-b9be-4934-b914-a9eeb34923f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723b3731-1bd5-426b-9b63-b0ade4536277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723b3731-1bd5-426b-9b63-b0ade4536277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19', 'volume_name': 'volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b37d9-f3a5-4d5b-93f9-cff877712635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b37d9-f3a5-4d5b-93f9-cff877712635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a42d20b-4c10-4f96-8df3-187decc880a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19', 'volume_size': 1} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (dfcebccf-59c3-40a7-8afb-394a4857850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82cee14-ad79-477b-ad08-41da040a5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-d079356d-4332-43db-ac98-ef2bfe14755c-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "cinder-d079356d-4332-43db-ac98-ef2bfe14755c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82cee14-ad79-477b-ad08-41da040a5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445194744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ae9782-afb5-4120-b3cf-46a0c45fbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:24Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544917ea-beed-472b-b5f0-8d53cce9575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544917ea-beed-472b-b5f0-8d53cce9575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692348d2-18b0-455b-b6b4-a7762a3b3b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692348d2-18b0-455b-b6b4-a7762a3b3b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ae9782-afb5-4120-b3cf-46a0c45fbc13', 'volume_name': 'volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e716993-f1c4-40ef-bf12-9b890cdd7312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e716993-f1c4-40ef-bf12-9b890cdd7312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a178044a-0ad6-4038-ba02-eece8949fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume d2ae9782-afb5-4120-b3cf-46a0c45fbc13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13', 'volume_size': 1} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-d079356d-4332-43db-ac98-ef2bfe14755c" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-d079356d-4332-43db-ac98-ef2bfe14755c" acquired by "delete_volume" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17875cc0-d7c9-438c-846c-12ee6cfba629]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:24 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:56:24 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:24 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f 1073741824" returned: 0 in 1.223s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:24 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (46fa4a21-4355-4458-a307-38671f6f3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561786ea-03e0-4823-b9ec-4863c5b8642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.116s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561786ea-03e0-4823-b9ec-4863c5b8642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1421915523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b4b4b9-fbda-480d-bb2a-eb65008625ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:24Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a125c9-629d-4bd3-ba1a-fd2a6758d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a125c9-629d-4bd3-ba1a-fd2a6758d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb433af-cf03-4cfd-ab1f-483a8bf9b463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb433af-cf03-4cfd-ab1f-483a8bf9b463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b4b4b9-fbda-480d-bb2a-eb65008625ca', 'volume_name': 'volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67155654-785e-4b70-b97d-5424fc692dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67155654-785e-4b70-b97d-5424fc692dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba2ec42-ac69-4648-bc17-c782bb401947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume 07b4b4b9-fbda-480d-bb2a-eb65008625ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca', 'volume_size': 1} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5ca66434-0536-47ad-a276-b58f9131692b tempest-VolumesGetTest-994103817 None] Lock "cinder-6dae4f74-51d1-4459-a5ef-fecbe464b31e-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:24 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f Apr 28 04:56:24 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (a5b807eb-c289-4f7b-ac43-5530dade1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c48075-dea3-4f23-8304-c4a5b7396cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "cinder-c2caeacc-8626-4b17-9813-7601d58dc6d8-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c48075-dea3-4f23-8304-c4a5b7396cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488347708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eadf0d9-e466-4a81-b94e-2cc12015b254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:25Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61919130-bcb3-48f5-9599-8e81b87a4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61919130-bcb3-48f5-9599-8e81b87a4d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf56092-d313-4e88-ae6a-4f51c47772c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf56092-d313-4e88-ae6a-4f51c47772c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eadf0d9-e466-4a81-b94e-2cc12015b254', 'volume_name': 'volume-7eadf0d9-e466-4a81-b94e-2cc12015b254', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee8b112-ef9e-4535-bedd-07c13028de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee8b112-ef9e-4535-bedd-07c13028de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858b829a-e93d-4f79-8e8f-7023d3208dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume 7eadf0d9-e466-4a81-b94e-2cc12015b254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eadf0d9-e466-4a81-b94e-2cc12015b254', 'volume_size': 1} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-c2caeacc-8626-4b17-9813-7601d58dc6d8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:25 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.839s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "cinder-quobyte-c2caeacc-8626-4b17-9813-7601d58dc6d8" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:25 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c Apr 28 04:56:25 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-quobyte-c2caeacc-8626-4b17-9813-7601d58dc6d8" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fbbb80-036e-4839-8509-97d8f642d184]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:25 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 Apr 28 04:56:25 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:25 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f" returned: 0 in 0.584s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932984325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:23Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:25 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a979afc9-e517-477b-b150-d8d09689541e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d62bf8-de11-446f-9dde-bbfff050e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:25 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 1073741824 Apr 28 04:56:25 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f (dc2e2adc-1b96-4429-8efb-110ea53ba13f): created successfully Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d62bf8-de11-446f-9dde-bbfff050e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (3eb5fe53-ec7c-430c-8a7c-f1c2e364c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-347b1e0f-d2f9-4e60-a9b1-33bf586c5e1a tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:25 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d079356d-4332-43db-ac98-ef2bfe14755c" returned: 0 in 0.571s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-d079356d-4332-43db-ac98-ef2bfe14755c" released by "delete_volume" :: held 1.503s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Created reservations ['b60dde38-47b0-4f2b-8084-114b617566b2', 'db2a7a00-ebd0-4914-85a4-dd8a89420d75', 'db0ae350-2ed8-4c3d-a068-266b0bb73217', '5810800a-56c5-4637-8a77-09b36026e568'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:25 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8" returned: 0 in 0.731s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:25 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:25 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:25 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8 Apr 28 04:56:25 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:26 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 1073741824" returned: 0 in 0.825s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:26 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 Apr 28 04:56:26 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:26 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c2caeacc-8626-4b17-9813-7601d58dc6d8" returned: 0 in 0.636s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-quobyte-c2caeacc-8626-4b17-9813-7601d58dc6d8" released by "delete_volume" :: held 1.409s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:26 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.718s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-25c515ad-3b26-4b4d-8236-6cb57ef80ea6 tempest-VolumesGetTest-994103817 None] Lock "cinder-d079356d-4332-43db-ac98-ef2bfe14755c-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Created reservations ['222c526b-bd62-415f-b1ca-101429b30b42', 'b91f9211-7acf-4501-8722-bb2d0815d8f6', 'd4db57e8-7f40-44d3-b875-9977662ea398', '4a55ba04-e7a5-4884-89f4-6329b6da6529'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:26 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:26 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:26 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Flow 'volume_create_manager' (1bec2303-5bf9-4a11-8815-da68c1dcab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e0085-2699-4afd-8927-cf9e0c97bac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" returned: 0 in 0.788s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445194744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ae9782-afb5-4120-b3cf-46a0c45fbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:24Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume d2ae9782-afb5-4120-b3cf-46a0c45fbc13 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e0085-2699-4afd-8927-cf9e0c97bac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1303381901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3bdb1e-589b-4056-8f52-5f09f40089fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19568e34577f48a18b9e15f21cee349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:27Z,use_quota=True,user_id='498a7bd6b20e40469e38c5eb88517c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9210b6-e336-4fe7-98e6-f96980b7eea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 1073741824 Apr 28 04:56:27 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9210b6-e336-4fe7-98e6-f96980b7eea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c586e3-62d2-44f7-a1c1-15fb78acf02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c586e3-62d2-44f7-a1c1-15fb78acf02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3bdb1e-589b-4056-8f52-5f09f40089fb', 'volume_name': 'volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1daa908-5750-4bc9-a34e-6817192d315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1daa908-5750-4bc9-a34e-6817192d315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b4fa43-1551-4e1b-a9b0-b7890284d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Volume 9a3bdb1e-589b-4056-8f52-5f09f40089fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb', 'volume_size': 1} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a42d20b-4c10-4f96-8df3-187decc880a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eabadac-a578-4449-90f1-efe5be6967bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (b5e66b17-96dd-4829-bfb8-b7cb8edaf279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6c6118-9815-46fe-8457-fce0451bc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 (c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19): created successfully Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eabadac-a578-4449-90f1-efe5be6967bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (93616a2f-cd3f-4a8c-8458-99aa781db893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6c6118-9815-46fe-8457-fce0451bc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-725242692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9dad70-ba2b-4a7a-b591-ca944a81213e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:27Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9c2f6a-5f7c-4567-a026-7d0139f90b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9c2f6a-5f7c-4567-a026-7d0139f90b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79f075-28a0-4c21-97db-2fa24b81d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.image.glance [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Creating Keystone auth plugin from conf {{(pid=82097) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "cinder-60e33fb7-3938-4fb8-b357-8e6ace5330a0-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4c26d74b-c0c6-48af-b364-9bb9c17f41f0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-60e33fb7-3938-4fb8-b357-8e6ace5330a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "cinder-quobyte-60e33fb7-3938-4fb8-b357-8e6ace5330a0" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-quobyte-60e33fb7-3938-4fb8-b357-8e6ace5330a0" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f0f998-8947-4db6-8944-45b97f8d221a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:27 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.571s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Deleted volume successfully. Apr 28 04:56:27 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 Apr 28 04:56:27 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4c64819a-c913-48a7-a62b-ce46b0f7b7ae tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-c2caeacc-8626-4b17-9813-7601d58dc6d8-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79f075-28a0-4c21-97db-2fa24b81d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a9dad70-ba2b-4a7a-b591-ca944a81213e', 'volume_name': 'volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f557cef-0ce3-4808-a677-63ee4e2e6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f557cef-0ce3-4808-a677-63ee4e2e6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b8c0e0-7f9b-4ad2-8f01-73012f24fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Trying to clone 3a9dad70-ba2b-4a7a-b591-ca944a81213e from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]). {{(pid=82097) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 04:56:27 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Image download 20.69 MB at 20.69 MB/s Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d560f-e704-4800-9a01-2ce342a23a0c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:27 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 1073741824" returned: 0 in 0.995s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:28 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0" returned: 0 in 0.753s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:28 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD Apr 28 04:56:28 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:28 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0 Apr 28 04:56:28 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:28 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 Apr 28 04:56:28 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:28 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 is fetched for user 837fc46e0b3c4d6d8eb66dbd68118928. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2b6e9-633d-4865-8f80-d2fb0d002738]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:28 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" returned: 0 in 0.478s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:28 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.874s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1421915523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b4b4b9-fbda-480d-bb2a-eb65008625ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:24Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume 07b4b4b9-fbda-480d-bb2a-eb65008625ca {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:28 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-60e33fb7-3938-4fb8-b357-8e6ace5330a0" returned: 0 in 0.563s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:28 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca 1073741824 Apr 28 04:56:28 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:28 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD Apr 28 04:56:28 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a178044a-0ad6-4038-ba02-eece8949fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96dfae9-5dab-486e-9cd2-a9235dc78c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-quobyte-60e33fb7-3938-4fb8-b357-8e6ace5330a0" released by "delete_volume" :: held 1.388s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:28 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 (d2ae9782-afb5-4120-b3cf-46a0c45fbc13): created successfully Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96dfae9-5dab-486e-9cd2-a9235dc78c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (dfcebccf-59c3-40a7-8afb-394a4857850f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e7241c3e-84bb-4b8c-8424-aa49df5721d4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Created reservations ['a544e4a7-208b-4138-8de3-2de54d05a0fa', '361d4569-1db0-4e65-b65a-172a452a0e70', 'd1e2b0b7-1f2b-4d88-9b7e-b50668df4744', '82de0c5d-36aa-4ac9-be2c-ce7ca714efc8'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:28 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:28 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:29 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:29 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca 1073741824" returned: 0 in 0.609s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:29 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca Apr 28 04:56:29 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:29 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Deleted volume successfully. Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b80e6d01-6042-4272-b79f-341ab627f254 tempest-ServersNegativeTestJSON-498337351 None] Lock "cinder-60e33fb7-3938-4fb8-b357-8e6ace5330a0-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:29 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca" returned: 0 in 0.551s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.758s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488347708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eadf0d9-e466-4a81-b94e-2cc12015b254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39b823442c7497db4797ea4122aa342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:25Z,use_quota=True,user_id='c508e4abed1040e7b1a937890125a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Creating volume 7eadf0d9-e466-4a81-b94e-2cc12015b254 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:29 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:29 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 1073741824 Apr 28 04:56:29 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba2ec42-ac69-4648-bc17-c782bb401947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d04e319-f8ff-457d-a110-2dae3075d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca (07b4b4b9-fbda-480d-bb2a-eb65008625ca): created successfully Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d04e319-f8ff-457d-a110-2dae3075d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (46fa4a21-4355-4458-a307-38671f6f3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cdcc8265-1925-4d96-a66b-14d928bf494c tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:30 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 1073741824" returned: 0 in 0.665s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:30 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 Apr 28 04:56:30 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:31 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254" returned: 0 in 0.557s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.999s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1303381901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3bdb1e-589b-4056-8f52-5f09f40089fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19568e34577f48a18b9e15f21cee349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:27Z,use_quota=True,user_id='498a7bd6b20e40469e38c5eb88517c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Creating volume 9a3bdb1e-589b-4056-8f52-5f09f40089fb {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:31 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858b829a-e93d-4f79-8e8f-7023d3208dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eadf0d9-e466-4a81-b94e-2cc12015b254', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2023512a-fbf5-4ba5-900e-522f2de9a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:31 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Volume volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 (7eadf0d9-e466-4a81-b94e-2cc12015b254): created successfully Apr 28 04:56:31 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb 1073741824 Apr 28 04:56:31 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2023512a-fbf5-4ba5-900e-522f2de9a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Flow 'volume_create_manager' (a5b807eb-c289-4f7b-ac43-5530dade1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4af0f98e-9e94-4e3e-8c6d-bda0a55d7b24 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created volume successfully. Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-7eadf0d9-e466-4a81-b94e-2cc12015b254-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-7eadf0d9-e466-4a81-b94e-2cc12015b254-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-7eadf0d9-e466-4a81-b94e-2cc12015b254" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-7eadf0d9-e466-4a81-b94e-2cc12015b254" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[92041db5-de1b-4681-a270-13925bdb1ad8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:31 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 Apr 28 04:56:31 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:31 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb 1073741824" returned: 0 in 0.767s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:31 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb Apr 28 04:56:31 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:32 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254" returned: 0 in 0.626s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:32 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254 Apr 28 04:56:32 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:32 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb" returned: 0 in 0.551s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-725242692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9dad70-ba2b-4a7a-b591-ca944a81213e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:27Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Creating volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:32 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b4fa43-1551-4e1b-a9b0-b7890284d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:32 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1073741824 Apr 28 04:56:32 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9d4bc5-adaf-4023-b2ac-5161d53eb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:32 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Volume volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb (9a3bdb1e-589b-4056-8f52-5f09f40089fb): created successfully Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9d4bc5-adaf-4023-b2ac-5161d53eb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Flow 'volume_create_manager' (1bec2303-5bf9-4a11-8815-da68c1dcab9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:32 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a68c98f-19ac-443b-8f24-5519ec81a0e2 tempest-VolumesTransfersV355Test-1493066263 None] Created volume successfully. Apr 28 04:56:32 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7eadf0d9-e466-4a81-b94e-2cc12015b254" returned: 0 in 0.541s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-7eadf0d9-e466-4a81-b94e-2cc12015b254" released by "delete_volume" :: held 1.209s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['c799dcbe-3bc0-46fa-8501-92812399504c', '6d872506-2f67-4ec7-bd69-fa2af223f9df', '0381786c-6981-4469-898d-37f64aef1728', '1db71509-9927-47bd-9f1a-2cf9f035eef9'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:32 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:32 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:33 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1073741824" returned: 0 in 0.726s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:33 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:33 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:33 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1222fa09-a1c8-46ce-b967-f7a5cb2b81da tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-7eadf0d9-e466-4a81-b94e-2cc12015b254-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:33 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 0 in 0.528s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-07b4b4b9-fbda-480d-bb2a-eb65008625ca-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Attempting download of 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-07b4b4b9-fbda-480d-bb2a-eb65008625ca-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-07b4b4b9-fbda-480d-bb2a-eb65008625ca" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[32014de0-f585-40f3-9fbd-10931a189046]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-07b4b4b9-fbda-480d-bb2a-eb65008625ca" acquired by "delete_volume" :: waited 0.037s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b3a83d-77db-42f4-aeb6-138afb8928ee]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:33 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2 Apr 28 04:56:33 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ec430f0f-4738-402a-9a76-76896d7ba19b tempest-VolumesTransfersV355Test-1215802780 None] Transfer volume completed successfully. Apr 28 04:56:34 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca Apr 28 04:56:34 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:34 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2" returned: 0 in 0.558s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:34 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca" returned: 0 in 0.562s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:34 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2 Apr 28 04:56:34 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:34 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca Apr 28 04:56:34 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "cinder-9a3bdb1e-589b-4056-8f52-5f09f40089fb-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-9a3bdb1e-589b-4056-8f52-5f09f40089fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "cinder-quobyte-9a3bdb1e-589b-4056-8f52-5f09f40089fb" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-quobyte-9a3bdb1e-589b-4056-8f52-5f09f40089fb" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:35 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:35 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2" returned: 1 in 0.624s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_zwlf11x2' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-07b4b4b9-fbda-480d-bb2a-eb65008625ca" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bcff12-5d38-49da-8d20-897e50820499]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706bd63-edf9-4b48-b3bf-d0302aefa8ec]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-07b4b4b9-fbda-480d-bb2a-eb65008625ca" released by "delete_volume" :: held 1.192s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:35 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD Apr 28 04:56:35 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['c4a858ab-96cd-4b51-b10e-12ec1440aaf0', 'c027464f-7278-4bb7-916c-cb3771f619f3', 'ecd93fef-f5a5-4b94-9812-b0dbe1646d69', 'a05fe23d-6918-4406-ab50-b30a169d9721'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:35 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb Apr 28 04:56:35 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:35 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:35 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:35 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 was qcow2, converting to raw {{(pid=82097) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:35 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:35 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:35 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb" returned: 0 in 0.615s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:35 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:35 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-0cb96205-e409-40b9-ad4e-d61c127f52b0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-07b4b4b9-fbda-480d-bb2a-eb65008625ca-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:35 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb Apr 28 04:56:35 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-d2ae9782-afb5-4120-b3cf-46a0c45fbc13-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-d2ae9782-afb5-4120-b3cf-46a0c45fbc13-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17045ce8-9a89-48b9-a318-8c920c3074df]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:36 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 Apr 28 04:56:36 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:36 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9a3bdb1e-589b-4056-8f52-5f09f40089fb" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-quobyte-9a3bdb1e-589b-4056-8f52-5f09f40089fb" released by "delete_volume" :: held 1.284s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Created reservations ['8f6cc2b1-8388-4e82-b581-e890aedab5fb', '0cfe8f0e-9745-4d1f-9507-53784817004a', 'f4025e4c-b147-4705-934c-4f2b1d1c92c0', 'ab96d5ee-e7c9-4237-8dcf-e61f61abafaa'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:36 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:36 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:36 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" returned: 0 in 0.620s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:36 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13 Apr 28 04:56:36 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:37 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Deleted volume successfully. Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ee2b92ba-c83e-4cd5-b416-5417e497813f tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-9a3bdb1e-589b-4056-8f52-5f09f40089fb-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:37 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 0 in 1.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_n8h5ebredevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:56:37 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Converted 112.00 MB image at 72.36 MB/s Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:37 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1G Apr 28 04:56:37 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:37 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" returned: 0 in 0.597s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-d2ae9782-afb5-4120-b3cf-46a0c45fbc13" released by "delete_volume" :: held 1.277s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['b02e2976-e628-4c97-b603-a2af27ff2b0d', 'efcbdac1-1eb2-4e6b-8802-a5bf8d195e7d', 'd685e52f-3a57-43dc-a62e-88ad208c4e76', '79070085-fecd-4e09-a5be-dffe0c0d78b6'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:37 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:37 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Flow 'volume_create_manager' (219a176c-1cbe-487b-8502-f6488a3fb2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41137f-74cc-4e7b-a8fd-20cbb1b58019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41137f-74cc-4e7b-a8fd-20cbb1b58019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-20675801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ad7697-a678-44da-a863-5bae170e942a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19568e34577f48a18b9e15f21cee349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:38Z,use_quota=True,user_id='498a7bd6b20e40469e38c5eb88517c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3b0a17-45d0-4d20-a5e2-5930293ea355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3b0a17-45d0-4d20-a5e2-5930293ea355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee51f8e1-9a20-48f9-b47b-ffdde50779a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee51f8e1-9a20-48f9-b47b-ffdde50779a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ad7697-a678-44da-a863-5bae170e942a', 'volume_name': 'volume-94ad7697-a678-44da-a863-5bae170e942a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f968f-e73b-4782-b059-1d755fb706c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f968f-e73b-4782-b059-1d755fb706c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd53199e-f18d-4a51-ada7-f2c9fb114a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:37 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Volume 94ad7697-a678-44da-a863-5bae170e942a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ad7697-a678-44da-a863-5bae170e942a', 'volume_size': 1} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-20675801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ad7697-a678-44da-a863-5bae170e942a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19568e34577f48a18b9e15f21cee349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:38Z,use_quota=True,user_id='498a7bd6b20e40469e38c5eb88517c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Creating volume 94ad7697-a678-44da-a863-5bae170e942a {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:37 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:37 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a 1073741824 Apr 28 04:56:37 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:37 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e 1G" returned: 0 in 0.653s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f34c2-a193-469c-8d19-b80ed682a520]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:37 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:37 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:38 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.603s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aa159fdf-f932-45a8-8e9a-5fc9ffde3013 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-d2ae9782-afb5-4120-b3cf-46a0c45fbc13-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" acquired by "delete_volume" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc64296-f429-48a2-9e0c-3f7ebfe18a03]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:38 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 Apr 28 04:56:38 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:38 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 0 in 0.770s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:38 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a 1073741824" returned: 0 in 0.974s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:38 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:38 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:38 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a Apr 28 04:56:38 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:39 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" returned: 0 in 0.693s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:39 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:39 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a" returned: 0 in 0.477s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:39 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19 Apr 28 04:56:39 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd53199e-f18d-4a51-ada7-f2c9fb114a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ad7697-a678-44da-a863-5bae170e942a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc42850c-f03c-465e-b5a6-7a2715d6364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 1 in 0.608s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Downloaded image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e successfully. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 for user 837fc46e0b3c4d6d8eb66dbd68118928 is deleted. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Marking volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e as bootable. {{(pid=82097) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 04:56:39 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Volume volume-94ad7697-a678-44da-a863-5bae170e942a (94ad7697-a678-44da-a863-5bae170e942a): created successfully Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc42850c-f03c-465e-b5a6-7a2715d6364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Flow 'volume_create_manager' (219a176c-1cbe-487b-8502-f6488a3fb2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Copying metadata from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 to 3a9dad70-ba2b-4a7a-b591-ca944a81213e. {{(pid=82097) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Creating volume glance metadata for volume 3a9dad70-ba2b-4a7a-b591-ca944a81213e backed by image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82097) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 04:56:39 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d91238c2-84d1-43b7-9f8b-ba5b70fbe2c7 tempest-VolumesTransfersV355Test-1493066263 None] Created volume successfully. Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b8c0e0-7f9b-4ad2-8f01-73012f24fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720e1a4-4596-4bc2-83ca-dd77e33d1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:39 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Volume volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e (3a9dad70-ba2b-4a7a-b591-ca944a81213e): created successfully Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720e1a4-4596-4bc2-83ca-dd77e33d1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (b5e66b17-96dd-4829-bfb8-b7cb8edaf279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:39 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-175dda3a-dcd7-45ab-a1fb-31dce04eac4f tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:56:39 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" returned: 0 in 0.554s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19" released by "delete_volume" :: held 1.306s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:39 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['8a09b886-aa47-4e23-8020-f8e65ca96105', '2524c2b0-b196-425e-9d28-854f7b180d39', '6223773d-58bd-4218-813e-7ebd07bfcd41', '31d6c063-a8d3-4127-92e3-0f7519b4a8ad'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:40 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:40 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "cinder-94ad7697-a678-44da-a863-5bae170e942a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-94ad7697-a678-44da-a863-5bae170e942a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "cinder-quobyte-94ad7697-a678-44da-a863-5bae170e942a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-quobyte-94ad7697-a678-44da-a863-5bae170e942a" acquired by "delete_volume" :: waited 0.012s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[611868f0-e33b-47c0-800f-70dd1257410f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:40 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a Apr 28 04:56:40 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:40 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.640s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:40 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-afb09d85-2ec6-4328-8691-c7e4bef07e00 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-c9376eec-bd5b-4c0d-b0f3-e224dd0c7f19-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-dc2e2adc-1b96-4429-8efb-110ea53ba13f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-dc2e2adc-1b96-4429-8efb-110ea53ba13f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (c7f25f44-dd19-4f34-b452-f134f9684340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf19e84-6d18-454e-bb98-a424d5424620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-dc2e2adc-1b96-4429-8efb-110ea53ba13f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf19e84-6d18-454e-bb98-a424d5424620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735405630',display_name='tempest-VolumesGetTest-Volume-1256403011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac776ab-d49d-4ed3-b3e0-dde0fca409c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:41Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af741b0c-e0e9-4c8c-b852-bf79f9ada620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af741b0c-e0e9-4c8c-b852-bf79f9ada620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac68f4f-51aa-4118-926d-97cadd51c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac68f4f-51aa-4118-926d-97cadd51c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac776ab-d49d-4ed3-b3e0-dde0fca409c5', 'volume_name': 'volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebb2101-aa25-4d2d-b589-94aea2da07a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebb2101-aa25-4d2d-b589-94aea2da07a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1972bd8-b86d-4c85-8b0c-cb76e171643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:40 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Volume 8ac776ab-d49d-4ed3-b3e0-dde0fca409c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5', 'volume_size': 1} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735405630',display_name='tempest-VolumesGetTest-Volume-1256403011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac776ab-d49d-4ed3-b3e0-dde0fca409c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891cd9785aa4c28b22b24f6579468a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:41Z,use_quota=True,user_id='837fc46e0b3c4d6d8eb66dbd68118928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Creating volume 8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:40 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-dc2e2adc-1b96-4429-8efb-110ea53ba13f" acquired by "delete_volume" :: waited 0.088s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:40 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 1073741824 Apr 28 04:56:40 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af7a170-e840-4b2d-ba79-c450df0dfb6f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:41 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f Apr 28 04:56:41 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:41 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a" returned: 0 in 0.841s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:41 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a Apr 28 04:56:41 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:41 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f" returned: 0 in 0.704s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:41 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f Apr 28 04:56:41 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:41 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 1073741824" returned: 0 in 0.821s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:41 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 Apr 28 04:56:41 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:41 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-94ad7697-a678-44da-a863-5bae170e942a" returned: 0 in 0.719s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-quobyte-94ad7697-a678-44da-a863-5bae170e942a" released by "delete_volume" :: held 1.623s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:41 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Created reservations ['b433daea-7588-4ba5-8a54-56fe98e07f50', '200af467-7e65-4bd8-8318-bedbb9706997', 'fd85420a-8dc9-426b-9dfb-90e95ae1c986', 'd88946b8-8f3d-4fea-84ec-ca7242f18bb9'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:42 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:42 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:42 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc2e2adc-1b96-4429-8efb-110ea53ba13f" returned: 0 in 0.620s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-dc2e2adc-1b96-4429-8efb-110ea53ba13f" released by "delete_volume" :: held 1.369s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['ebb56525-8719-4ae6-85d0-53aca4750dd4', 'b05f3483-54c3-421b-839c-cd77ea080ffd', 'a3cf8b27-3445-4e84-9657-03a07e57a035', 'd2552518-272b-413e-b355-dff0980563d8'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:42 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" returned: 0 in 0.646s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1972bd8-b86d-4c85-8b0c-cb76e171643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc7f020-0eac-43d7-941d-f4f992bfd5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:42 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Volume volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 (8ac776ab-d49d-4ed3-b3e0-dde0fca409c5): created successfully Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc7f020-0eac-43d7-941d-f4f992bfd5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Flow 'volume_create_manager' (c7f25f44-dd19-4f34-b452-f134f9684340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:42 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e4459faa-a55b-433f-b714-2a6a460ce25f tempest-VolumesGetTest-994103817 None] Created volume successfully. Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:42 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:42 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:42 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:42 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Deleted volume successfully. Apr 28 04:56:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3aec33d4-cee9-47c9-8fa4-8b04603c5d61 tempest-VolumesTransfersV355Test-35836631 None] Lock "cinder-94ad7697-a678-44da-a863-5bae170e942a-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-9eb2fb84-080a-4b43-bd56-09fc69c4cfee-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-9eb2fb84-080a-4b43-bd56-09fc69c4cfee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-9eb2fb84-080a-4b43-bd56-09fc69c4cfee" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-9eb2fb84-080a-4b43-bd56-09fc69c4cfee" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleting offline snapshot 9eb2fb84-080a-4b43-bd56-09fc69c4cfee of volume a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] snapshot_file for this snap is: volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "cinder-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ef031a-543b-4f06-8138-6515fe92453c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:43 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.759s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8521a985-cae8-4724-bd55-363132873c46]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4b0ec1b8-0b87-41ff-850b-6c74920237f4 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-dc2e2adc-1b96-4429-8efb-110ea53ba13f-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:43 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee Apr 28 04:56:43 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:43 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 Apr 28 04:56:43 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:43 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee" returned: 0 in 0.721s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a85d06b7-46ff-497d-a507-913954f4640b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8faa6e-bb71-4024-98bb-8b447a44a228]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:44 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" returned: 0 in 0.697s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:44 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5 Apr 28 04:56:44 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:44 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b Apr 28 04:56:44 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:44 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" returned: 0 in 0.619s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5" released by "delete_volume" :: held 1.371s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Created reservations ['8fa63fe7-2ef7-41e7-a527-cf28665259a8', '1aba19a1-91ef-4279-b22f-9892b7bd8665', '12d95b24-7f09-4620-822a-1f73dbe3cb79', '23fb3b8d-23b9-4aaa-a602-e0b29d046542'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:44 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b" returned: 0 in 0.799s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:44 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:44 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:44 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee Apr 28 04:56:44 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:45 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b7cd1169-3161-47ab-b996-4a80f4d83e1f tempest-VolumesGetTest-994103817 None] Lock "cinder-8ac776ab-d49d-4ed3-b3e0-dde0fca409c5-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:45 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee" returned: 0 in 0.669s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:45 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee Apr 28 04:56:45 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e17ce1fe-a9b2-4776-b8a8-495046a1f32d tempest-BackendsCapabilitiesAdminTestsJSON-1156503188 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82097) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a5e2db1e-253b-433a-b624-fdcbb711a1bb tempest-BackendsCapabilitiesAdminTestsJSON-1156503188 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82097) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-3a9dad70-ba2b-4a7a-b591-ca944a81213e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "cinder-3a9dad70-ba2b-4a7a-b591-ca944a81213e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Acquiring lock "cinder-quobyte-3a9dad70-ba2b-4a7a-b591-ca944a81213e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-3a9dad70-ba2b-4a7a-b591-ca944a81213e" acquired by "delete_volume" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0a5fe-3615-4642-bfa4-b478c93dda26]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:45 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:45 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:46 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b.9eb2fb84-080a-4b43-bd56-09fc69c4cfee" returned: 0 in 0.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-9eb2fb84-080a-4b43-bd56-09fc69c4cfee" released by "_delete_snapshot" :: held 2.919s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" released by "delete_snapshot" :: held 2.977s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['9d47576e-e60b-4d54-99e1-01192ed8b683', '1ae6eaf0-aedd-4194-845d-86e824dc8001', 'aed77f92-1673-4281-8b9c-3af51f795600', '3425e22a-55e5-4074-9c0a-236d3bd4b110'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Delete snapshot completed successfully. Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d03d11c3-1aa0-4917-a104-6e8f04f829a8 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-9eb2fb84-080a-4b43-bd56-09fc69c4cfee-delete_snapshot" released by "delete_snapshot" :: held 3.158s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-a85d06b7-46ff-497d-a507-913954f4640b-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-a85d06b7-46ff-497d-a507-913954f4640b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a94824f-d739-4dec-add2-33997e062361]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:46 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 0 in 0.746s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:46 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b Apr 28 04:56:46 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:46 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:46 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:47 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b" returned: 0 in 0.749s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:47 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b Apr 28 04:56:47 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:47 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 1 in 0.712s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:47 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e Apr 28 04:56:47 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:47 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a85d06b7-46ff-497d-a507-913954f4640b" returned: 0 in 0.574s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-quobyte-a85d06b7-46ff-497d-a507-913954f4640b" released by "delete_volume" :: held 1.423s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:47 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3a9dad70-ba2b-4a7a-b591-ca944a81213e" returned: 0 in 0.631s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Created reservations ['df3b4a03-6e54-4e8a-8c49-0772ffdb25ed', '9400fbf6-91ab-4a14-8c70-e97e4f457d45', 'c65883e4-c1bc-4516-9265-2a9929614e5c', '7196b7df-cec8-437c-89af-873f5075bdc5'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "cinder-quobyte-3a9dad70-ba2b-4a7a-b591-ca944a81213e" released by "delete_volume" :: held 2.189s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:48 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:48 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Created reservations ['1fdaac05-e0db-4d74-b204-5a939baf5157', '498d57b8-a3fd-44d0-92b1-32a73997a0a9', '27db4e18-774f-499c-aadd-fdaccbcbffa7', '2f875237-0c57-4912-b0eb-218699e0d727'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:48 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:48 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Flow 'volume_create_manager' (8ca80cd9-6626-454b-9734-68bf30daaeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422c29f7-5e23-4541-a6dd-fddd2f8b3ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:48 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422c29f7-5e23-4541-a6dd-fddd2f8b3ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-719151720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca70c14b-d1af-4374-b7b8-5a397081a254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd953d21b204005a9e227a0558bcbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:49Z,use_quota=True,user_id='ba50113f34004a1c94d72b3e2f00b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b5e53-0ad5-4681-b014-bcab1b8648fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b5e53-0ad5-4681-b014-bcab1b8648fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9386b4b3-a6e5-4c59-a3fb-0acf3363de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.image.glance [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Creating Keystone auth plugin from conf {{(pid=82097) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.683s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Deleted volume successfully. Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5a1ac27f-039c-41ae-a633-b7a10360bde0 tempest-CreateVolumesFromSnapshotTest-2017570552 None] Lock "cinder-a85d06b7-46ff-497d-a507-913954f4640b-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:48 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.728s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Deleted volume successfully. Apr 28 04:56:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-df6a4929-83e2-4cc9-a522-20db666c79cc tempest-VolumesGetTest-994103817 None] Lock "cinder-3a9dad70-ba2b-4a7a-b591-ca944a81213e-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9386b4b3-a6e5-4c59-a3fb-0acf3363de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca70c14b-d1af-4374-b7b8-5a397081a254', 'volume_name': 'volume-ca70c14b-d1af-4374-b7b8-5a397081a254', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b176d8-7c30-4ec2-aa29-a15a671a07fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b176d8-7c30-4ec2-aa29-a15a671a07fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a28ee-1b4b-4698-888c-87869673a2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:49 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Volume ca70c14b-d1af-4374-b7b8-5a397081a254: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca70c14b-d1af-4374-b7b8-5a397081a254', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Trying to clone ca70c14b-d1af-4374-b7b8-5a397081a254 from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]). {{(pid=82097) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 04:56:49 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Image download 20.69 MB at 20.69 MB/s Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54d9f3d-307b-4373-9391-fbd2efcf2f00]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:49 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD Apr 28 04:56:49 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:50 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:50 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 is fetched for user ba50113f34004a1c94d72b3e2f00b9e1. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 04:56:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[beae18cc-8611-4740-85d6-66d491d86a7d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:50 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD Apr 28 04:56:50 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:51 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-719151720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca70c14b-d1af-4374-b7b8-5a397081a254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd953d21b204005a9e227a0558bcbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:49Z,use_quota=True,user_id='ba50113f34004a1c94d72b3e2f00b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Creating volume ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:51 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:51 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1073741824 Apr 28 04:56:51 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:51 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1073741824" returned: 0 in 0.831s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:52 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:56:52 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f957f17c-d564-4b28-8b10-676f3c312dcc tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-50726504: creating Apr 28 04:56:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f957f17c-d564-4b28-8b10-676f3c312dcc tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-50726504: created successfully Apr 28 04:56:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f957f17c-d564-4b28-8b10-676f3c312dcc tempest-GroupSnapshotsTest-2132040142 None] Create group completed successfully. Apr 28 04:56:52 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 0.621s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Attempting download of 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume ca70c14b-d1af-4374-b7b8-5a397081a254. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1d6647-d8a4-42b0-b958-63b20ba03290]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:52 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1 Apr 28 04:56:52 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:53 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:53 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1 Apr 28 04:56:53 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:54 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1" returned: 1 in 0.811s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_41nsv4g1' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d3521-fdaa-4d22-aa9b-4b324ab4d51d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (dcdc2789-4cc1-4f37-8340-46fd0aedec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ee0330-02ed-4600-b899-0b8ea5c2b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:54 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD Apr 28 04:56:54 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ee0330-02ed-4600-b899-0b8ea5c2b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670907531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e68192a-54df-48f1-9af0-fc58cc03aa8e,host='devstack@QuobyteHD#QuobyteHD',id=7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:54Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95fa712e-7af9-4849-a989-1ecf1fc03ecf),volume_type_id=95fa712e-7af9-4849-a989-1ecf1fc03ecf)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00ea57-4939-4694-b57b-7b508ba7f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00ea57-4939-4694-b57b-7b508ba7f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3615f133-7104-48c8-b00a-6f7698114b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3615f133-7104-48c8-b00a-6f7698114b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9', 'volume_name': 'volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35540158-360f-4092-859d-a386e69b4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35540158-360f-4092-859d-a386e69b4736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15255f80-c2ad-4200-b8e4-493d65810111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:54 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Volume 7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9', 'volume_size': 1} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e68192a-54df-48f1-9af0-fc58cc03aa8e,created_at=2026-04-28T02:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670907531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e68192a-54df-48f1-9af0-fc58cc03aa8e,host='devstack@QuobyteHD#QuobyteHD',id=7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:54Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95fa712e-7af9-4849-a989-1ecf1fc03ecf),volume_type_id=95fa712e-7af9-4849-a989-1ecf1fc03ecf)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Creating volume 7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:54 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:54 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 1073741824 Apr 28 04:56:54 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:54 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 was qcow2, converting to raw {{(pid=82097) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 04:56:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:54 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:56:54 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:55 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 1073741824" returned: 0 in 0.885s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:55 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:56:55 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (c4976da2-c4d1-4d09-928b-41fe3ea0058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705af76d-986d-4e7b-a6f7-1a598c63b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705af76d-986d-4e7b-a6f7-1a598c63b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326058182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5351943-1e2c-48da-ba79-964041b82ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:56Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396f4c8-ce88-400d-a12a-d4deca5868ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396f4c8-ce88-400d-a12a-d4deca5868ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67e844e-1d02-49bb-ad88-23aabb43b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67e844e-1d02-49bb-ad88-23aabb43b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5351943-1e2c-48da-ba79-964041b82ff6', 'volume_name': 'volume-b5351943-1e2c-48da-ba79-964041b82ff6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae97b0-4798-44ff-b451-b5810d60417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae97b0-4798-44ff-b451-b5810d60417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb20cf8f-b7c0-439a-8310-5e60e6d16e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:55 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Volume b5351943-1e2c-48da-ba79-964041b82ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5351943-1e2c-48da-ba79-964041b82ff6', 'volume_size': 1} Apr 28 04:56:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.798s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326058182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5351943-1e2c-48da-ba79-964041b82ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:56Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Creating volume b5351943-1e2c-48da-ba79-964041b82ff6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:56 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 1073741824 Apr 28 04:56:56 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (1115ac4d-ecbb-4870-b4ea-2eae0bf3393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef443d6d-f363-4543-8da6-39523006d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef443d6d-f363-4543-8da6-39523006d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590027259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed95747b-1ead-4664-82e5-124cfe5f1737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:56Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813b2f2c-56da-4eb2-af26-d7a064e3a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813b2f2c-56da-4eb2-af26-d7a064e3a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d77daf-75ba-4705-92d8-b504ddd63cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d77daf-75ba-4705-92d8-b504ddd63cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed95747b-1ead-4664-82e5-124cfe5f1737', 'volume_name': 'volume-ed95747b-1ead-4664-82e5-124cfe5f1737', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f328b747-017b-496b-ad9f-58a4fe0c444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f328b747-017b-496b-ad9f-58a4fe0c444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9582bfac-b8b9-4cad-8733-ee3d74a607e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Volume ed95747b-1ead-4664-82e5-124cfe5f1737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed95747b-1ead-4664-82e5-124cfe5f1737', 'volume_size': 1} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15255f80-c2ad-4200-b8e4-493d65810111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72a9ab2-8841-46e7-ad2a-22688cb32a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Volume volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 (7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9): created successfully Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72a9ab2-8841-46e7-ad2a-22688cb32a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (dcdc2789-4cc1-4f37-8340-46fd0aedec53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-823730cb-7d0c-4061-9b50-253aa2fb4846 tempest-GroupSnapshotsTest-2132040142 None] Created volume successfully. Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:56 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:56:56 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (2712c9e8-8322-4402-9db1-990f806816fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9418c44-f74a-4b4e-a27c-07dd01e4ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9418c44-f74a-4b4e-a27c-07dd01e4ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334748625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee78a2f5-ae9d-48e6-be54-05d60515a6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5165b167-e792-4c82-b0a6-4d10b5d37711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5165b167-e792-4c82-b0a6-4d10b5d37711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcb78f5-ee72-4551-9c57-90bd42596d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcb78f5-ee72-4551-9c57-90bd42596d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee78a2f5-ae9d-48e6-be54-05d60515a6c6', 'volume_name': 'volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadf60e4-b521-4617-b1aa-d622be292c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadf60e4-b521-4617-b1aa-d622be292c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102ba57c-a708-4a9e-9730-54004950efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Volume ee78a2f5-ae9d-48e6-be54-05d60515a6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6', 'volume_size': 1} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] GroupSnapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: creating. Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Group snapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: creating. {{(pid=82097) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:56 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 2.130s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83_d6cfx5pldevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:56:56 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Converted 112.00 MB image at 52.53 MB/s Apr 28 04:56:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:57 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1G Apr 28 04:56:57 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:57 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (3544e4e1-aff5-42bb-971c-d7ed7af1ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bc1fee-1d9d-41e7-8a6c-ccc262addf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 1073741824" returned: 0 in 1.067s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bc1fee-1d9d-41e7-8a6c-ccc262addf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859381036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6c5cd0-e420-4bb3-ad90-135c73df0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c62ea9-c2f2-4e4a-ac89-d2fa175e46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c62ea9-c2f2-4e4a-ac89-d2fa175e46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6b401a-adef-4958-a6a8-41e4dc10d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6b401a-adef-4958-a6a8-41e4dc10d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6c5cd0-e420-4bb3-ad90-135c73df0d32', 'volume_name': 'volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3e8192-f7b4-4548-8565-bae22e3426f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3e8192-f7b4-4548-8565-bae22e3426f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82fb6dc-3fcf-443d-a5d5-057ecb317f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Volume de6c5cd0-e420-4bb3-ad90-135c73df0d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32', 'volume_size': 1} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.796s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:57 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 Apr 28 04:56:57 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (75442d3b-7f30-42c7-bea3-060f4ee2cb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac505d5-73b5-42b1-9963-c794d8435159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac505d5-73b5-42b1-9963-c794d8435159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028591452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0767b6cf-9513-4c8f-ab22-aceb50db9a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085170f6-4071-4d94-9742-0c1b62414c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085170f6-4071-4d94-9742-0c1b62414c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b53887-8ff1-4967-9a28-0f5190b9b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b53887-8ff1-4967-9a28-0f5190b9b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0767b6cf-9513-4c8f-ab22-aceb50db9a76', 'volume_name': 'volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcae78b7-9f2c-441d-b3bf-d1e3bb623fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcae78b7-9f2c-441d-b3bf-d1e3bb623fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d55513-994b-4389-964e-afd25865ad25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Volume 0767b6cf-9513-4c8f-ab22-aceb50db9a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76', 'volume_size': 1} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:57 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 1G" returned: 0 in 0.728s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed87ab-47db-4c8d-903a-498ee745184c]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:56:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:57 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:56:57 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:58 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6" returned: 0 in 0.671s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590027259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed95747b-1ead-4664-82e5-124cfe5f1737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:56Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Creating volume ed95747b-1ead-4664-82e5-124cfe5f1737 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:58 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb20cf8f-b7c0-439a-8310-5e60e6d16e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5351943-1e2c-48da-ba79-964041b82ff6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b98ffa-9bd5-4e89-a175-d4d491ee0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:58 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 1073741824 Apr 28 04:56:58 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:58 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Volume volume-b5351943-1e2c-48da-ba79-964041b82ff6 (b5351943-1e2c-48da-ba79-964041b82ff6): created successfully Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b98ffa-9bd5-4e89-a175-d4d491ee0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (c4976da2-c4d1-4d09-928b-41fe3ea0058a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:58 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aba35eaa-8afd-45eb-b0f0-4d290087ee4e tempest-CreateVolumesFromImageTest-1054389927 None] Created volume successfully. Apr 28 04:56:58 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 0.685s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:58 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:56:58 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:58 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 1073741824" returned: 0 in 0.782s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:58 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 Apr 28 04:56:58 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:59 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 1 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Downloaded image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}])) to volume ca70c14b-d1af-4374-b7b8-5a397081a254 successfully. {{(pid=82097) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Temporary image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 for user ba50113f34004a1c94d72b3e2f00b9e1 is deleted. {{(pid=82097) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.volume_utils [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Marking volume ca70c14b-d1af-4374-b7b8-5a397081a254 as bootable. {{(pid=82097) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Copying metadata from image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 to ca70c14b-d1af-4374-b7b8-5a397081a254. {{(pid=82097) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Creating volume glance metadata for volume ca70c14b-d1af-4374-b7b8-5a397081a254 backed by image 3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82097) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a28ee-1b4b-4698-888c-87869673a2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca70c14b-d1af-4374-b7b8-5a397081a254', 'volume_size': 1, 'image_id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '504a40e0fd6241bf88dcf6f37231d46f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83', 'created_at': datetime.datetime(2026, 4, 28, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 2, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e8e074a-6da5-40d7-a4e4-fad4ce7bbc83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dda1fb2-4599-4f9e-82ee-826ddad9f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Volume volume-ca70c14b-d1af-4374-b7b8-5a397081a254 (ca70c14b-d1af-4374-b7b8-5a397081a254): created successfully Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dda1fb2-4599-4f9e-82ee-826ddad9f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Flow 'volume_create_manager' (8ca80cd9-6626-454b-9734-68bf30daaeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-864e45fd-dbda-4cf5-91f3-6a376a72d5a1 tempest-VolumesExtendTest-515837616 None] Created volume successfully. Apr 28 04:56:59 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737" returned: 0 in 0.563s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334748625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee78a2f5-ae9d-48e6-be54-05d60515a6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Creating volume ee78a2f5-ae9d-48e6-be54-05d60515a6c6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:56:59 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9582bfac-b8b9-4cad-8733-ee3d74a607e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed95747b-1ead-4664-82e5-124cfe5f1737', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:59 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 1073741824 Apr 28 04:56:59 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276545be-45b6-498d-b546-33adccec36f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:56:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Volume volume-ed95747b-1ead-4664-82e5-124cfe5f1737 (ed95747b-1ead-4664-82e5-124cfe5f1737): created successfully Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276545be-45b6-498d-b546-33adccec36f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (1115ac4d-ecbb-4870-b4ea-2eae0bf3393c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:56:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:56:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-07f9de11-7c75-4a36-bfe8-ac13c6a60bab tempest-CreateVolumesFromImageTest-1054389927 None] Created volume successfully. Apr 28 04:57:00 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 1073741824" returned: 0 in 0.703s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:00 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 Apr 28 04:57:00 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:00 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" returned: 0 in 0.524s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.755s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Creating offline snapshot d8ea6901-7539-49eb-a55b-e28765ed84df of volume 7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102ba57c-a708-4a9e-9730-54004950efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1c63df-3d67-4772-a1b5-7256432e4481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58930d-589b-466f-a06b-fc8315d0c832]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:00 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Volume volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 (ee78a2f5-ae9d-48e6-be54-05d60515a6c6): created successfully Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1c63df-3d67-4772-a1b5-7256432e4481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (2712c9e8-8322-4402-9db1-990f806816fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3c50fac2-36eb-4438-b908-248ace100693 tempest-CreateVolumesFromImageTest-1054389927 None] Created volume successfully. Apr 28 04:57:00 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:00 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:01 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.721s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:01 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df 1G Apr 28 04:57:01 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:02 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df 1G" returned: 0 in 0.727s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:02 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:02 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:02 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.534s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:02 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:02 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:02 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:03 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:03 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info Apr 28 04:57:03 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:03 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info" returned: 0 in 0.569s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:03 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:03 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info Apr 28 04:57:03 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:04 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.info" returned: 0 in 0.515s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.674s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.085s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859381036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6c5cd0-e420-4bb3-ad90-135c73df0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Creating volume de6c5cd0-e420-4bb3-ad90-135c73df0d32 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:04 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:04 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 1073741824 Apr 28 04:57:04 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-45be61f1-0faa-4777-a89d-a4fb801693ae tempest-GroupSnapshotsTest-2132040142 None] group_snapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: created successfully Apr 28 04:57:05 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 1073741824" returned: 0 in 0.684s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:05 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 Apr 28 04:57:05 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:05 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32" returned: 0 in 0.560s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.099s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028591452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0767b6cf-9513-4c8f-ab22-aceb50db9a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86f7d2197cf47d39337fe8e722a4983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:56:57Z,use_quota=True,user_id='d15b199bb6b14462842e6f05e8b02508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Creating volume 0767b6cf-9513-4c8f-ab22-aceb50db9a76 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:05 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82fb6dc-3fcf-443d-a5d5-057ecb317f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d2bc61-e720-4b5e-9811-5933ce6f5836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:05 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 1073741824 Apr 28 04:57:05 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:05 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Volume volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 (de6c5cd0-e420-4bb3-ad90-135c73df0d32): created successfully Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d2bc61-e720-4b5e-9811-5933ce6f5836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (3544e4e1-aff5-42bb-971c-d7ed7af1ae82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-74b0d6f4-480e-4f7f-825e-df6925d2a338 tempest-CreateVolumesFromImageTest-1054389927 None] Created volume successfully. Apr 28 04:57:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:06 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 1073741824" returned: 0 in 0.796s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:06 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 Apr 28 04:57:06 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:07 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76" returned: 0 in 0.476s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.494s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d55513-994b-4389-964e-afd25865ad25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1947999-def1-4c65-ba7b-015c875c4ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:07 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Volume volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 (0767b6cf-9513-4c8f-ab22-aceb50db9a76): created successfully Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1947999-def1-4c65-ba7b-015c875c4ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Flow 'volume_create_manager' (75442d3b-7f30-42c7-bea3-060f4ee2cb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5502c986-7c15-4f6a-92b4-770c8c0b5b29]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:07 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9b8b0fea-03da-4d3f-9b10-80531a716c5b tempest-CreateVolumesFromImageTest-1054389927 None] Created volume successfully. Apr 28 04:57:07 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:57:07 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-0767b6cf-9513-4c8f-ab22-aceb50db9a76-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-0767b6cf-9513-4c8f-ab22-aceb50db9a76-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-quobyte-0767b6cf-9513-4c8f-ab22-aceb50db9a76" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-0767b6cf-9513-4c8f-ab22-aceb50db9a76" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78e56f-6ccb-417f-b609-212ce5d69bc5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:07 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 Apr 28 04:57:07 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:07 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 0.612s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:07 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:57:07 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:08 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76" returned: 0 in 0.561s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:08 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76 Apr 28 04:57:08 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:08 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 1 in 0.567s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 2G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 2G" returned: 0 in 0.073s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.305s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.041s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Creating volume 3e72b8ef-6ad3-492f-bbbb-aa9982b1197a from snapshot d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-59a60699-9ddb-4626-946c-e3863c51f6e6 tempest-VolumesExtendTest-515837616 None] Extend volume completed successfully. Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] snapshot: d8ea6901-7539-49eb-a55b-e28765ed84df, volume: 3e72b8ef-6ad3-492f-bbbb-aa9982b1197a, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bd409-889f-45f0-8001-e3ad48775be5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:08 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:08 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:08 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0767b6cf-9513-4c8f-ab22-aceb50db9a76" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-0767b6cf-9513-4c8f-ab22-aceb50db9a76" released by "delete_volume" :: held 1.231s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Created reservations ['90c5f8ce-ba5f-4dc2-bf75-1ae62ba374a1', '247553cf-5c31-4766-b817-8cd8bb48f070', '283f3ed6-9731-4fce-a8be-ebb1dce57019', '9f77464b-6dac-4b55-80c2-dc207e69d287'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:08 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:08 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:09 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.683s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53556304-b7a9-4cb6-bec0-2d4b65ef4952]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:09 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:09 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-ca70c14b-d1af-4374-b7b8-5a397081a254-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "cinder-ca70c14b-d1af-4374-b7b8-5a397081a254-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:09 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.633s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:09 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Deleted volume successfully. Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-quobyte-ca70c14b-d1af-4374-b7b8-5a397081a254" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cde3c4e6-e0ad-45ed-99bc-07955b5a6a51 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-0767b6cf-9513-4c8f-ab22-aceb50db9a76-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-ca70c14b-d1af-4374-b7b8-5a397081a254" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e476579f-5cc1-44ea-8314-ca543101b522]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-de6c5cd0-e420-4bb3-ad90-135c73df0d32-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-de6c5cd0-e420-4bb3-ad90-135c73df0d32-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-quobyte-de6c5cd0-e420-4bb3-ad90-135c73df0d32" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-de6c5cd0-e420-4bb3-ad90-135c73df0d32" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f777d2-7edb-48b3-978c-80678a2dc59c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:09 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:57:09 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:09 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.786s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:57:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:10 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a Apr 28 04:57:10 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:10 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 Apr 28 04:57:10 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:10 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 0.792s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:10 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32" returned: 0 in 0.639s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:10 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32 Apr 28 04:57:10 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:10 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:57:10 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:11 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-de6c5cd0-e420-4bb3-ad90-135c73df0d32" returned: 0 in 0.802s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-de6c5cd0-e420-4bb3-ad90-135c73df0d32" released by "delete_volume" :: held 1.501s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Created reservations ['ac2c796e-ed2e-4f17-9439-3e3834eeed8b', 'a19a5de1-4bd0-4019-92c4-fabcc8f614a1', 'd4720f5f-0434-41e7-98e9-a102f4a12fd7', 'ce306cdb-80f6-4ec6-ae4c-6c3c89c91575'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:11 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:11 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:11 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 1 in 1.429s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 04:57:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:12 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254 Apr 28 04:57:12 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-ee78a2f5-ae9d-48e6-be54-05d60515a6c6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-ee78a2f5-ae9d-48e6-be54-05d60515a6c6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=178,cinder:UPDATE=223,cinder:INSERT=68,cinder:DELETE=17 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-quobyte-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" acquired by "delete_volume" :: waited 0.051s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[551dd767-cf13-46bb-9e5a-b2eee0942ab8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:12 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 Apr 28 04:57:12 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:13 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ca70c14b-d1af-4374-b7b8-5a397081a254" returned: 0 in 1.402s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-ca70c14b-d1af-4374-b7b8-5a397081a254" released by "delete_volume" :: held 3.717s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=226,cinder:DELETE=23,cinder:INSERT=58,cinder:SELECT=161 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Created reservations ['f70b69ea-e5d0-485a-8aec-f2d42731ce14', '3d8afb0f-04cc-4fc9-8d8b-6414240d6f4b', '6752a922-24d8-417a-a9f2-b551b059ed70', 'c2064000-0694-47a4-b785-e9a17bb47186'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:13 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:13 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:13 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 2.039s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Deleted volume successfully. Apr 28 04:57:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d387fdf3-2f55-4a6a-83f3-9e6985944aec tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-de6c5cd0-e420-4bb3-ad90-135c73df0d32-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:14 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" returned: 0 in 1.621s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:14 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.637s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:14 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Deleted volume successfully. Apr 28 04:57:14 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6 Apr 28 04:57:14 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9e520c63-56bb-4590-ba2a-2cc13bf6c1c5 tempest-VolumesExtendTest-515837616 None] Lock "cinder-ca70c14b-d1af-4374-b7b8-5a397081a254-delete_volume" released by "delete_volume" :: held 4.843s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Flow 'volume_create_manager' (48f45a42-294c-48fa-a8ba-9ff2744e53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e023d655-0cd7-4f5d-b91e-d21e2e814421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e023d655-0cd7-4f5d-b91e-d21e2e814421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1508746286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a45306-0acd-41bb-b4dc-88024edaee53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd953d21b204005a9e227a0558bcbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:15Z,use_quota=True,user_id='ba50113f34004a1c94d72b3e2f00b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1915edce-70a7-4677-8cb0-71ce3c5ed679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1915edce-70a7-4677-8cb0-71ce3c5ed679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0001cc-24cc-4ad2-9433-e445ea3ee146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0001cc-24cc-4ad2-9433-e445ea3ee146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a45306-0acd-41bb-b4dc-88024edaee53', 'volume_name': 'volume-88a45306-0acd-41bb-b4dc-88024edaee53', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be82ebe0-c600-4256-ae76-17f1b83012c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be82ebe0-c600-4256-ae76-17f1b83012c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed49f7-6d2b-405b-b9ab-4493e85ba89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Volume 88a45306-0acd-41bb-b4dc-88024edaee53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a45306-0acd-41bb-b4dc-88024edaee53', 'volume_size': 1} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:15 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" returned: 0 in 1.332s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-ee78a2f5-ae9d-48e6-be54-05d60515a6c6" released by "delete_volume" :: held 3.045s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Created reservations ['0b71e860-9992-4bc4-8ca2-147b057010d0', '5cf094dd-ec22-4353-adfe-acf955317e1f', 'dcb8cd6f-2e35-4f3d-ad0a-ccec54d97ccd', 'ab95781b-cdea-449f-aed8-0e2f34c7e488'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:16 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:16 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-ed95747b-1ead-4664-82e5-124cfe5f1737-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-ed95747b-1ead-4664-82e5-124cfe5f1737-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-quobyte-ed95747b-1ead-4664-82e5-124cfe5f1737" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-ed95747b-1ead-4664-82e5-124cfe5f1737" acquired by "delete_volume" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03623f-887f-4d23-894e-3b7ca28ab49a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:17 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 Apr 28 04:57:17 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:17 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.271s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:17 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Deleted volume successfully. Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3088cf4f-4dfb-4416-afd6-8e94811a10f9 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-ee78a2f5-ae9d-48e6-be54-05d60515a6c6-delete_volume" released by "delete_volume" :: held 4.923s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:17 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" returned: 0 in 7.414s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7903de-5f36-4267-a1b1-4b01c49b2a1e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:17 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:17 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:17 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737" returned: 0 in 1.013s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:17 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737 Apr 28 04:57:17 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:18 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.673s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:57:18 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Converted 1024.00 MB image at 138.09 MB/s Apr 28 04:57:18 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:18 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a Apr 28 04:57:18 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:18 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ed95747b-1ead-4664-82e5-124cfe5f1737" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-ed95747b-1ead-4664-82e5-124cfe5f1737" released by "delete_volume" :: held 1.594s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Created reservations ['8f0fa7ec-cc93-414e-ab2a-d8ac5b4a595d', '8267736a-98dc-4cb5-98c3-198a47831a13', '176481be-0274-419e-b5dc-ed9292fef11c', '524ccf0a-7949-4979-8a89-06daacd53344'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:18 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:18 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:18 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" returned: 0 in 0.538s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" released by "_copy_volume_from_snapshot" :: held 10.209s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" released by "_create_volume_from_snapshot" :: held 10.253s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.288s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1508746286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a45306-0acd-41bb-b4dc-88024edaee53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd953d21b204005a9e227a0558bcbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:15Z,use_quota=True,user_id='ba50113f34004a1c94d72b3e2f00b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Creating volume 88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:18 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:18 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 1073741824 Apr 28 04:57:18 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-b5351943-1e2c-48da-ba79-964041b82ff6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-b5351943-1e2c-48da-ba79-964041b82ff6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "cinder-quobyte-b5351943-1e2c-48da-ba79-964041b82ff6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-fc8e1f8a-c929-41e7-9646-6739e907cfcf tempest-GroupSnapshotsTest-2132040142 None] Create group from source-snapshot-e848fd03-b238-46e0-af17-f1c0ec45c1a1 completed successfully. Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-b5351943-1e2c-48da-ba79-964041b82ff6" acquired by "delete_volume" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8bd9b5-a5a7-4310-8e3e-45720de39a97]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:18 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.554s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Deleted volume successfully. Apr 28 04:57:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6364024b-4fc1-4271-93c7-e4e052201cfd tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-ed95747b-1ead-4664-82e5-124cfe5f1737-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:18 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 Apr 28 04:57:18 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:19 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 1073741824" returned: 0 in 0.893s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:19 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6" returned: 0 in 0.744s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:19 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:19 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:19 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6 Apr 28 04:57:19 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e133c-dba5-4ff0-a848-e1c101c79775]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:20 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a Apr 28 04:57:20 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:20 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:20 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b5351943-1e2c-48da-ba79-964041b82ff6" returned: 0 in 0.574s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-quobyte-b5351943-1e2c-48da-ba79-964041b82ff6" released by "delete_volume" :: held 1.374s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 0.625s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed49f7-6d2b-405b-b9ab-4493e85ba89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a45306-0acd-41bb-b4dc-88024edaee53', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7243cdb8-55c2-42bd-8c04-482cf79e7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Volume volume-88a45306-0acd-41bb-b4dc-88024edaee53 (88a45306-0acd-41bb-b4dc-88024edaee53): created successfully Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7243cdb8-55c2-42bd-8c04-482cf79e7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Flow 'volume_create_manager' (48f45a42-294c-48fa-a8ba-9ff2744e53a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-01c0d885-56eb-4c14-9946-fb0825c4017b tempest-VolumesExtendTest-515837616 None] Created volume successfully. Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Created reservations ['03e2283b-0d45-49db-94ca-e5c07419a10c', '6ed08104-c42b-48f2-938d-1ac4bf466d21', 'abf77c85-233e-45dc-b55f-86e5161379b2', '191ec127-a4c6-4ed8-80c3-b60686157e95'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:20 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:20 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Flow 'volume_create_manager' (c467c8ef-ecd0-433b-9eac-63f99652ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f6d0cc-9352-4968-aaeb-4aca806075df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f6d0cc-9352-4968-aaeb-4aca806075df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-165655828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626edc8c-b463-413c-a47e-c726f8f30276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b65312d5a344639b3487588759c391c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:20Z,use_quota=True,user_id='eb0693ba036247639cb662e910ddb47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f360569-1543-4eb5-9038-ea044810635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f360569-1543-4eb5-9038-ea044810635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2bc835-67d3-4214-918e-416bbb8abbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2bc835-67d3-4214-918e-416bbb8abbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626edc8c-b463-413c-a47e-c726f8f30276', 'volume_name': 'volume-626edc8c-b463-413c-a47e-c726f8f30276', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c8ee22-22ab-4de3-b7c4-c35f20265562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c8ee22-22ab-4de3-b7c4-c35f20265562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30fa75c-7c4e-45e2-8730-32f31389d8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Volume 626edc8c-b463-413c-a47e-c726f8f30276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626edc8c-b463-413c-a47e-c726f8f30276', 'volume_size': 1} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-165655828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626edc8c-b463-413c-a47e-c726f8f30276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b65312d5a344639b3487588759c391c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:20Z,use_quota=True,user_id='eb0693ba036247639cb662e910ddb47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Creating volume 626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:20 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:20 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 1073741824 Apr 28 04:57:20 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:20 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" returned: 0 in 0.735s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:20 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a Apr 28 04:57:20 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:21 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Deleted volume successfully. Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cf1212d2-ecf4-4ba3-ab22-a4ad8c37ff68 tempest-CreateVolumesFromImageTest-1054389927 None] Lock "cinder-b5351943-1e2c-48da-ba79-964041b82ff6-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:21 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" returned: 0 in 0.581s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-3e72b8ef-6ad3-492f-bbbb-aa9982b1197a" released by "delete_volume" :: held 1.357s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:21 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 1073741824" returned: 0 in 0.687s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['e4328bcd-4e10-4ae3-8276-5d2a23d0196f'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:21 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:21 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:21 devstack cinder-volume[82097]: WARNING cinder.quota [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-978966710 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-978966710, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:57:21 devstack cinder-volume[82097]: WARNING cinder.quota [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-978966710 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-978966710, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['fb3eae49-6bf2-43a4-962c-5934cbe47aec', '039fe540-9567-4986-878f-6c4a82f9b55a', 'da31972f-05a0-463b-af64-215555c56e11', 'ec03559b-53c8-41fc-9c77-55db0a22ecd1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:21 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:21 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:21 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.586s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.995s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30fa75c-7c4e-45e2-8730-32f31389d8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626edc8c-b463-413c-a47e-c726f8f30276', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e113263-9bb4-44f3-94fc-d0abe49bde10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Creating offline snapshot b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 of volume 88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Volume volume-626edc8c-b463-413c-a47e-c726f8f30276 (626edc8c-b463-413c-a47e-c726f8f30276): created successfully Apr 28 04:57:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e113263-9bb4-44f3-94fc-d0abe49bde10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Flow 'volume_create_manager' (c467c8ef-ecd0-433b-9eac-63f99652ca05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dadfb5b-d745-4f99-89b8-dcd4086cde78]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9bd4258c-86a1-4dc2-8bb3-7a8e9251d319 tempest-SnapshotDependencyTests-1373036585 None] Created volume successfully. Apr 28 04:57:22 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:22 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:22 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.560s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d5d22459-02fe-45f2-8fb0-f1ce47ed328b tempest-GroupSnapshotsTest-2132040142 None] Delete group completed successfully. Apr 28 04:57:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] group_snapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: deleting Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] group_snapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: deleting {{(pid=82097) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Deleting offline snapshot d8ea6901-7539-49eb-a55b-e28765ed84df of volume 7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] snapshot_file for this snap is: volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c2f32-74ea-4c88-ae0d-a125ad54cb7d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:22 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:22 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:22 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 0.654s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:22 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 1G Apr 28 04:57:22 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:23 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d55011-9498-4b9c-b80a-f7cd56a1614b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:23 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:23 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:23 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 1G" returned: 0 in 0.652s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a45306-0acd-41bb-b4dc-88024edaee53 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:23 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a45306-0acd-41bb-b4dc-88024edaee53 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 Apr 28 04:57:23 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:23 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:23 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:23 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:23 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a45306-0acd-41bb-b4dc-88024edaee53 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" returned: 0 in 0.490s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:23 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 is being set with open permissions: ugo+rw Apr 28 04:57:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:23 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 Apr 28 04:57:23 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:24 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.566s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:24 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df Apr 28 04:57:24 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:24 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" returned: 0 in 0.464s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:24 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info Apr 28 04:57:24 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:24 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9.d8ea6901-7539-49eb-a55b-e28765ed84df" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ea6901-7539-49eb-a55b-e28765ed84df" released by "_delete_snapshot" :: held 2.286s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" released by "delete_snapshot" :: held 2.326s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:24 devstack cinder-volume[82097]: WARNING cinder.quota [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-978966710 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-978966710, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:57:24 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info" returned: 0 in 0.496s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:24 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info is being set with open permissions: ugo+rw Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:24 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['4810b1db-3e1e-4afc-a6c2-f65d22188be7', '94352fef-2198-4aa9-a2ac-677f4072b248', '544d2fce-c1e7-4b96-bf5a-93a0f3158234', '8bc1a1ab-9670-4876-b804-085e8f2faeec'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:24 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info Apr 28 04:57:24 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c09a6959-7f65-4927-a9b0-ddf6b00208e7 tempest-GroupSnapshotsTest-2132040142 None] group_snapshot e848fd03-b238-46e0-af17-f1c0ec45c1a1: deleted successfully Apr 28 04:57:25 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.info" returned: 0 in 0.484s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.417s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Creating offline snapshot da15d9f1-d299-432d-9aef-b7734147bc74 of volume 626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c5f41e54-1c98-4935-991a-b1fda5937581 tempest-VolumesExtendTest-515837616 None] Create snapshot completed successfully Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd36e65c-1e11-4243-86f2-6a55833afc89]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:25 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:25 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953d386-0d78-4fbc-a4c9-d55f616c45b9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:25 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:25 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:25 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:25 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 1G Apr 28 04:57:25 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:26 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.594s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:26 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9 Apr 28 04:57:26 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:26 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 1G" returned: 0 in 0.681s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626edc8c-b463-413c-a47e-c726f8f30276 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:26 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626edc8c-b463-413c-a47e-c726f8f30276 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:26 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:26 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" returned: 0 in 0.489s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-7b3b85f9-212d-4c2f-9b65-ba7c5b2143a9" released by "delete_volume" :: held 1.146s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['11385855-fc86-49ef-bd2e-70e3561850f4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:27 devstack cinder-volume[82097]: WARNING cinder.db.sqlalchemy.api [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-978966710'] Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['725df52f-2604-4147-ac33-1edb328f027e', '94c76118-6141-4427-9682-3e604744c8aa', '7a0fa2ae-ee3e-4d61-bd63-9b441c269bc0', 'ac81c5b8-97d2-4845-b208-d6555b7aa3df'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:27 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626edc8c-b463-413c-a47e-c726f8f30276 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.534s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:27 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 is being set with open permissions: ugo+rw Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:27 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:27 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:27 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:27 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:27 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.434s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:27 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info Apr 28 04:57:27 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:27 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:27 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a9199aa-96b3-4efd-90c0-9c51272eade5 tempest-GroupSnapshotsTest-2132040142 None] Delete group completed successfully. Apr 28 04:57:28 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info" returned: 0 in 0.462s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:28 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info is being set with open permissions: ugo+rw Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:28 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info Apr 28 04:57:28 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d413c94b-da7d-4bc3-b62c-cc73c1e17699 tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-177183387: creating Apr 28 04:57:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d413c94b-da7d-4bc3-b62c-cc73c1e17699 tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-177183387: created successfully Apr 28 04:57:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d413c94b-da7d-4bc3-b62c-cc73c1e17699 tempest-GroupSnapshotsTest-2132040142 None] Create group completed successfully. Apr 28 04:57:28 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.info" returned: 0 in 0.480s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.277s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe1ce1-30a7-4c71-b12d-90a20baf6f0a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8e688b20-1535-44eb-965e-1526ad0f2008 tempest-SnapshotDependencyTests-1373036585 None] Create snapshot completed successfully Apr 28 04:57:28 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:28 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:29 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 0.527s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 2G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 2G" returned: 0 in 0.120s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.680s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-de019d54-14e6-4448-a3bf-22fd153965d9 tempest-VolumesExtendTest-515837616 None] Extend volume completed successfully. Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Flow 'volume_create_manager' (1e57de31-00c8-4590-afa8-050a7571c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44cbf99-f942-47f2-9ce5-f038b5859f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44cbf99-f942-47f2-9ce5-f038b5859f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f4f76-71d1-452c-9d8d-28639302fe6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b65312d5a344639b3487588759c391c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da15d9f1-d299-432d-9aef-b7734147bc74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:30Z,use_quota=True,user_id='eb0693ba036247639cb662e910ddb47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9d8616-fd30-41cf-b69b-f28d2afa805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9d8616-fd30-41cf-b69b-f28d2afa805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12833834-9c15-4af1-8c52-37019b640496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12833834-9c15-4af1-8c52-37019b640496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '051f4f76-71d1-452c-9d8d-28639302fe6a', 'volume_name': 'volume-051f4f76-71d1-452c-9d8d-28639302fe6a', 'volume_size': 1, 'snapshot_id': 'da15d9f1-d299-432d-9aef-b7734147bc74'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcbb20f-3e40-4f2b-a323-707c84ad9457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcbb20f-3e40-4f2b-a323-707c84ad9457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4794a-36d7-4a7c-a0ad-661e083e728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Volume 051f4f76-71d1-452c-9d8d-28639302fe6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-051f4f76-71d1-452c-9d8d-28639302fe6a', 'volume_size': 1, 'snapshot_id': 'da15d9f1-d299-432d-9aef-b7734147bc74'} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74-051f4f76-71d1-452c-9d8d-28639302fe6a" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74-051f4f76-71d1-452c-9d8d-28639302fe6a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Creating volume 051f4f76-71d1-452c-9d8d-28639302fe6a from snapshot da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] snapshot: da15d9f1-d299-432d-9aef-b7734147bc74, volume: 051f4f76-71d1-452c-9d8d-28639302fe6a, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" acquired by "delete_snapshot" :: waited 0.049s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-quobyte-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Deleting offline snapshot b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 of volume 88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] snapshot_file for this snap is: volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65dff2f-0101-4cbb-9138-b750e94c85a4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde534e-c122-41c6-baea-3d2933fcb6ae]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (8a112cca-cf84-493f-8bf1-da640281060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b7b3aa-504d-445e-9ad0-5799abd707f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:30 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:30 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b7b3aa-504d-445e-9ad0-5799abd707f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-873124638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc4b7320-c978-4899-add1-52c12cbc5bac,host='devstack@QuobyteHD#QuobyteHD',id=b3a4f668-ff6b-4f10-9686-10f777da606e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:30Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73fb7d92-5324-4851-8b33-96a8c9bf3e45),volume_type_id=73fb7d92-5324-4851-8b33-96a8c9bf3e45)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e3fcab-04ac-4aa7-8f8a-3e12d19d62a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e3fcab-04ac-4aa7-8f8a-3e12d19d62a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:30 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 Apr 28 04:57:30 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd351ba-4ade-4060-aa75-1851cc1c0222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd351ba-4ade-4060-aa75-1851cc1c0222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a4f668-ff6b-4f10-9686-10f777da606e', 'volume_name': 'volume-b3a4f668-ff6b-4f10-9686-10f777da606e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acaf6e-c6d4-4766-85b0-ff7bf0310459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acaf6e-c6d4-4766-85b0-ff7bf0310459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402166eb-7c47-40f3-9aef-bf3147ef0f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:30 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Volume b3a4f668-ff6b-4f10-9686-10f777da606e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a4f668-ff6b-4f10-9686-10f777da606e', 'volume_size': 1} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:30 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-626edc8c-b463-413c-a47e-c726f8f30276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef2aae1-0c0b-42bd-849c-88b0003aff1c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:30 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a45306-0acd-41bb-b4dc-88024edaee53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a0960-aa9b-45a6-8cdb-c75cfd59e8a5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:30 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:30 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:30 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:30 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:31 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.549s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:31 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a Apr 28 04:57:31 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:31 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 0.558s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:31 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 Apr 28 04:57:31 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:31 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" returned: 0 in 0.613s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:31 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45 Apr 28 04:57:31 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:32 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53.b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" returned: 0 in 0.696s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45" released by "_delete_snapshot" :: held 2.578s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" released by "delete_snapshot" :: held 2.657s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:32 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Created reservations ['15c79aea-bc7f-4272-bfab-e51cd10fdc38', 'da8996c2-0a87-48e8-b6c6-1c94a115c6e0', '0c7da911-c6b0-41a5-9435-f4a099e7d434', '790d181f-20ae-40ff-a684-cbb9dd7cf810'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:32 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Delete snapshot completed successfully. Apr 28 04:57:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4d7fc3ee-8211-4421-85db-744521bba2bd tempest-VolumesExtendTest-515837616 None] Lock "cinder-b0bbabab-0f45-403a-bd4a-b84d4f9a6c45-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-88a45306-0acd-41bb-b4dc-88024edaee53-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "cinder-88a45306-0acd-41bb-b4dc-88024edaee53-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Acquiring lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" acquired by "delete_volume" :: waited 0.054s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7eceda-9664-4a1f-aaf5-80fa526a963b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:33 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:33 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:34 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 1.058s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:34 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53 Apr 28 04:57:34 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:35 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-88a45306-0acd-41bb-b4dc-88024edaee53" returned: 0 in 0.613s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "cinder-quobyte-88a45306-0acd-41bb-b4dc-88024edaee53" released by "delete_volume" :: held 1.813s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Created reservations ['d37aa483-da55-463d-931d-ea0796476a14', '2285f2c0-a17c-445d-8112-ff11bcf68343', '48b38ab3-6281-46b2-aae2-6c18de7a53cc', '630f4815-f228-4888-bb2b-f47850b047c2'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:35 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:35 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:36 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.894s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Deleted volume successfully. Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-91e724e2-5765-4169-ae22-d044174f3ab3 tempest-VolumesExtendTest-515837616 None] Lock "cinder-88a45306-0acd-41bb-b4dc-88024edaee53-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:36 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a" returned: 0 in 5.405s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d411bd3-94be-4c0b-a5ea-3ae1eb42a7b7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:36 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:36 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:37 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.772s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:57:37 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Converted 1024.00 MB image at 189.36 MB/s Apr 28 04:57:37 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a is being set with open permissions: ugo+rw Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:37 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a Apr 28 04:57:37 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:37 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a" returned: 0 in 0.503s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" released by "_copy_volume_from_snapshot" :: held 7.919s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74-051f4f76-71d1-452c-9d8d-28639302fe6a" released by "_create_volume_from_snapshot" :: held 7.961s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.985s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.699s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc4b7320-c978-4899-add1-52c12cbc5bac,created_at=2026-04-28T02:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-873124638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc4b7320-c978-4899-add1-52c12cbc5bac,host='devstack@QuobyteHD#QuobyteHD',id=b3a4f668-ff6b-4f10-9686-10f777da606e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:30Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73fb7d92-5324-4851-8b33-96a8c9bf3e45),volume_type_id=73fb7d92-5324-4851-8b33-96a8c9bf3e45)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Creating volume b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:37 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:37 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e 1073741824 Apr 28 04:57:37 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4794a-36d7-4a7c-a0ad-661e083e728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051f4f76-71d1-452c-9d8d-28639302fe6a', 'volume_size': 1, 'snapshot_id': 'da15d9f1-d299-432d-9aef-b7734147bc74'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bc7e9f-d7f9-4374-84d8-3817ef10a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:37 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Volume volume-051f4f76-71d1-452c-9d8d-28639302fe6a (051f4f76-71d1-452c-9d8d-28639302fe6a): created successfully Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bc7e9f-d7f9-4374-84d8-3817ef10a811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Flow 'volume_create_manager' (1e57de31-00c8-4590-afa8-050a7571c75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-abd6d956-7d67-4e13-a575-fa2bb0c3ec53 tempest-SnapshotDependencyTests-1373036585 None] Created volume successfully. Apr 28 04:57:38 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e 1073741824" returned: 0 in 0.747s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:38 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e Apr 28 04:57:38 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Flow 'volume_create_manager' (14812e79-b2a6-4ccf-824e-982d778f4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1991b57d-a20f-423f-b6e0-3456520f984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-da15d9f1-d299-432d-9aef-b7734147bc74-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1991b57d-a20f-423f-b6e0-3456520f984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1662305429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a040e15-5030-4b82-9428-a81e848f4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b618123639d425895d1555776417fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:38Z,use_quota=True,user_id='a5a77d34c95b426abe6cfba3e0a71518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c6a3f6-f6ca-4a0e-b398-df91ec7103f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c6a3f6-f6ca-4a0e-b398-df91ec7103f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6724b9-001f-4044-9b7a-cb571593b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6724b9-001f-4044-9b7a-cb571593b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a040e15-5030-4b82-9428-a81e848f4d8e', 'volume_name': 'volume-0a040e15-5030-4b82-9428-a81e848f4d8e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52e3c36-54fc-42e4-beaf-1d73449f7b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52e3c36-54fc-42e4-beaf-1d73449f7b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf43e3a0-bf59-4960-b5ba-7fa46e663bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:38 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Volume 0a040e15-5030-4b82-9428-a81e848f4d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a040e15-5030-4b82-9428-a81e848f4d8e', 'volume_size': 1} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-da15d9f1-d299-432d-9aef-b7734147bc74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Deleting offline snapshot da15d9f1-d299-432d-9aef-b7734147bc74 of volume 626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] snapshot_file for this snap is: volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cd9cf9-fa46-4ccd-9c70-f217407ae8b8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:38 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:38 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:39 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e" returned: 0 in 0.471s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1662305429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a040e15-5030-4b82-9428-a81e848f4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b618123639d425895d1555776417fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:38Z,use_quota=True,user_id='a5a77d34c95b426abe6cfba3e0a71518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Creating volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:39 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402166eb-7c47-40f3-9aef-bf3147ef0f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a4f668-ff6b-4f10-9686-10f777da606e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bed0245-7aed-4166-a535-9d08c08cdaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:39 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e 1073741824 Apr 28 04:57:39 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:39 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Volume volume-b3a4f668-ff6b-4f10-9686-10f777da606e (b3a4f668-ff6b-4f10-9686-10f777da606e): created successfully Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bed0245-7aed-4166-a535-9d08c08cdaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (8a112cca-cf84-493f-8bf1-da640281060f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:39 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a954f7e2-aaa8-4865-9a1c-325e7490cb4d tempest-GroupSnapshotsTest-2132040142 None] Created volume successfully. Apr 28 04:57:39 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-626edc8c-b463-413c-a47e-c726f8f30276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[90589046-e46e-4169-b5ad-204c9008abec]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:39 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:39 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:39 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e 1073741824" returned: 0 in 0.654s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:39 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e Apr 28 04:57:39 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:39 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:39 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:39 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:40 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e" returned: 0 in 0.491s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf43e3a0-bf59-4960-b5ba-7fa46e663bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a040e15-5030-4b82-9428-a81e848f4d8e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c34b45d-ccc9-4b85-8f67-f690a452f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Volume volume-0a040e15-5030-4b82-9428-a81e848f4d8e (0a040e15-5030-4b82-9428-a81e848f4d8e): created successfully Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c34b45d-ccc9-4b85-8f67-f690a452f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Flow 'volume_create_manager' (14812e79-b2a6-4ccf-824e-982d778f4739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:40 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-61349d29-402f-40f6-bf0c-aece67c0aeda tempest-VolumesSnapshotListTestJSON-973749681 None] Created volume successfully. Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:40 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:40 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74 Apr 28 04:57:40 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (f67240fb-bd8a-498f-be2a-6756f8fa9518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4fac9b-aa6a-485d-935b-47a2c852ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4fac9b-aa6a-485d-935b-47a2c852ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-642808936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc4b7320-c978-4899-add1-52c12cbc5bac,host='devstack@QuobyteHD#QuobyteHD',id=fbc79d52-9b6b-4eff-a932-0b5586578a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:40Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73fb7d92-5324-4851-8b33-96a8c9bf3e45),volume_type_id=73fb7d92-5324-4851-8b33-96a8c9bf3e45)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0c092-7432-4c2a-8fe7-1169fe1080c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0c092-7432-4c2a-8fe7-1169fe1080c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa64cdc-42f4-4e4c-8749-745adb53b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa64cdc-42f4-4e4c-8749-745adb53b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc79d52-9b6b-4eff-a932-0b5586578a02', 'volume_name': 'volume-fbc79d52-9b6b-4eff-a932-0b5586578a02', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930eabd-8cde-4dce-bcc2-2ff5a513a8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930eabd-8cde-4dce-bcc2-2ff5a513a8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dfa6f2-a336-4c3f-8eea-d2c01f8ade6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:40 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Volume fbc79d52-9b6b-4eff-a932-0b5586578a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc79d52-9b6b-4eff-a932-0b5586578a02', 'volume_size': 1} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc4b7320-c978-4899-add1-52c12cbc5bac,created_at=2026-04-28T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-642808936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc4b7320-c978-4899-add1-52c12cbc5bac,host='devstack@QuobyteHD#QuobyteHD',id=fbc79d52-9b6b-4eff-a932-0b5586578a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:57:40Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73fb7d92-5324-4851-8b33-96a8c9bf3e45),volume_type_id=73fb7d92-5324-4851-8b33-96a8c9bf3e45)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Creating volume fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:57:40 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:40 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 1073741824 Apr 28 04:57:40 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:40 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276.da15d9f1-d299-432d-9aef-b7734147bc74" returned: 0 in 0.514s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-da15d9f1-d299-432d-9aef-b7734147bc74" released by "_delete_snapshot" :: held 2.307s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" released by "delete_snapshot" :: held 2.335s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Created reservations ['a496b813-5867-4aed-90b5-7175d4d2d5dc', '48cb3fd0-0470-4083-9c8f-dd5bb865d3af', '7cf0c496-8f5e-4f7b-8af9-b5f9644c6f8c', 'f5144856-adfa-4707-b777-1fb194f9035e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Delete snapshot completed successfully. Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dd8642ec-605a-48f7-ac6b-194992e1dfe6 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-da15d9f1-d299-432d-9aef-b7734147bc74-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:41 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 1073741824" returned: 0 in 0.654s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:41 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 Apr 28 04:57:41 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-626edc8c-b463-413c-a47e-c726f8f30276-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:41 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-626edc8c-b463-413c-a47e-c726f8f30276-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02" returned: 0 in 0.496s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.941s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Creating offline snapshot 0837bb26-c052-49ef-bc44-20a8c20d5d3b of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dfa6f2-a336-4c3f-8eea-d2c01f8ade6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc79d52-9b6b-4eff-a932-0b5586578a02', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4757a476-e68f-4d53-8c8a-0847607a864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5812b-68a5-4a09-a11c-9190e7fd3ded]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:41 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Volume volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 (fbc79d52-9b6b-4eff-a932-0b5586578a02): created successfully Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4757a476-e68f-4d53-8c8a-0847607a864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (f67240fb-bd8a-498f-be2a-6756f8fa9518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:57:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-356ed949-18a8-42d5-8323-d7c6278808e4 tempest-GroupSnapshotsTest-2132040142 None] Created volume successfully. Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" acquired by "delete_volume" :: waited 0.048s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:41 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e Apr 28 04:57:41 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8110cf34-11d7-44b0-9bca-a022b2e66993]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:42 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:42 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:42 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:42 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b 1G Apr 28 04:57:42 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:42 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.527s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:42 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276 Apr 28 04:57:42 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:42 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c57547c1-1d8f-4041-b7a0-c3666e56ac4c tempest-GroupSnapshotsTest-2132040142 None] Update group completed successfully. Apr 28 04:57:42 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-626edc8c-b463-413c-a47e-c726f8f30276" returned: 0 in 0.498s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-626edc8c-b463-413c-a47e-c726f8f30276" released by "delete_volume" :: held 1.080s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Created reservations ['5b6a7551-efed-4f02-8530-89aac34926e7', 'cf27315f-b546-4b87-9671-929f328666c8', 'a91cb738-c385-4051-a51c-e4fe19e75c80', 'cf4047ca-f6bd-4baa-8dde-b419c3f90d60'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:43 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b 1G" returned: 0 in 0.634s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:43 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:57:43 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:43 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:43 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:43 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.494s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:43 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b is being set with open permissions: ugo+rw Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:43 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:57:43 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:43 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Deleted volume successfully. Apr 28 04:57:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-330fd1ec-706f-45bf-bae4-894921dd00a2 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-626edc8c-b463-413c-a47e-c726f8f30276-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:44 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-051f4f76-71d1-452c-9d8d-28639302fe6a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.481s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:44 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a5ff5d29-14ea-4bee-9aec-4a4255189b0e tempest-GroupSnapshotsTest-2132040142 None] Update group completed successfully. Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-051f4f76-71d1-452c-9d8d-28639302fe6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:44 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info Apr 28 04:57:44 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53482b-f96f-47ef-b612-d2395f9b0699]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:44 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a Apr 28 04:57:44 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:44 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:44 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info is being set with open permissions: ugo+rw Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:44 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info Apr 28 04:57:44 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:44 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a" returned: 0 in 0.526s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:44 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a Apr 28 04:57:44 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:45 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.info" returned: 0 in 0.456s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4bce4698-d5ba-4348-a7fd-d5b4749e7d9f tempest-VolumesSnapshotListTestJSON-973749681 None] Create snapshot completed successfully Apr 28 04:57:45 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-051f4f76-71d1-452c-9d8d-28639302fe6a" returned: 0 in 0.472s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-quobyte-051f4f76-71d1-452c-9d8d-28639302fe6a" released by "delete_volume" :: held 1.047s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7ba450e7-d4a0-4bc2-a90b-84329d255038 tempest-GroupSnapshotsTest-2132040142 None] Update group completed successfully. Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Created reservations ['3a2fce09-6936-49e9-9eba-cb329da53e01', '6208889a-3c10-4265-938d-9e7917bf68a6', 'b02cebca-4a77-4c10-817d-f974068cbd0a', '2dc22569-fbbc-4b34-848d-b7372db5c4e5'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:45 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:45 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:45 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.435s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Deleted volume successfully. Apr 28 04:57:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-3b339232-4ac2-4760-9665-16f70d6c09f7 tempest-SnapshotDependencyTests-1373036585 None] Lock "cinder-051f4f76-71d1-452c-9d8d-28639302fe6a-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Creating offline snapshot 4cad71fb-10ea-4153-9003-3f3ddcecc545 of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4e398-086f-4fa4-a439-84099e7b4716]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:46 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:57:46 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-700a03f0-f1d3-4afe-b448-2cf825a45b12 tempest-GroupSnapshotsTest-2132040142 None] Update group completed successfully. Apr 28 04:57:46 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.567s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:46 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 1G Apr 28 04:57:46 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:47 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 1G" returned: 0 in 0.691s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:47 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:57:47 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] GroupSnapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: creating. Apr 28 04:57:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Group snapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: creating. {{(pid=82097) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 04:57:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:48 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.614s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:48 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 is being set with open permissions: ugo+rw Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:48 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:57:48 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:48 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.470s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.773s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Creating offline snapshot 5804c3bf-4bfc-4c01-9876-ecde5bf6692c of volume fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3aa6325a-ac6d-436a-83a3-8b67c58354eb tempest-VolumesSnapshotListTestJSON-973749681 None] Create snapshot completed successfully Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a78576-509f-4b52-b81e-30ce9c4369c4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:48 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 Apr 28 04:57:48 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:49 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02" returned: 0 in 0.619s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:49 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c 1G Apr 28 04:57:49 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:50 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c 1G" returned: 0 in 0.702s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:50 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c Apr 28 04:57:50 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:50 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c" returned: 0 in 0.545s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:50 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:50 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c Apr 28 04:57:50 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:51 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c" returned: 0 in 0.493s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:51 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info Apr 28 04:57:51 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:51 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info" returned: 0 in 0.478s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:51 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:51 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info Apr 28 04:57:51 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:52 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.info" returned: 0 in 0.503s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Creating offline snapshot d8ad9560-a5f1-4d5e-bad5-02c35c968380 of volume b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[69728327-ba1f-4f69-a7c8-0a5815baaa8a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:52 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e Apr 28 04:57:52 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:52 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e" returned: 0 in 0.588s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:52 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 1G Apr 28 04:57:52 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:53 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 1G" returned: 0 in 0.709s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a4f668-ff6b-4f10-9686-10f777da606e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:53 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a4f668-ff6b-4f10-9686-10f777da606e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 Apr 28 04:57:53 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:54 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a4f668-ff6b-4f10-9686-10f777da606e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:54 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:54 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 Apr 28 04:57:54 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:54 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380" returned: 0 in 0.491s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:54 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info Apr 28 04:57:54 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:55 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:55 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:55 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info Apr 28 04:57:55 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:55 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.info" returned: 0 in 0.429s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.974s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Creating offline snapshot 34d83e85-1d83-4964-ba44-9906a2e6b378 of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4176f997-93d4-4238-a5a3-d0ec8ee9dc1b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:55 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:57:55 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:55 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-51fa74e9-f590-4acc-8c35-7b09be4b6a9a tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: created successfully Apr 28 04:57:56 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:56 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 1G Apr 28 04:57:56 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:56 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: deleting Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: deleting {{(pid=82097) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-5804c3bf-4bfc-4c01-9876-ecde5bf6692c" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-5804c3bf-4bfc-4c01-9876-ecde5bf6692c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Deleting offline snapshot 5804c3bf-4bfc-4c01-9876-ecde5bf6692c of volume fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] snapshot_file for this snap is: volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b9f4c-8cc0-4db9-bd42-2911d795e51f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:56 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:57:56 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:56 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c Apr 28 04:57:56 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:56 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 1G" returned: 0 in 0.726s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:56 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 Apr 28 04:57:56 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:57 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.489s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:57:57 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c" returned: 0 in 0.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbc79d52-9b6b-4eff-a932-0b5586578a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a7490-3ad5-47f0-95ef-f648a4bbf0d8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:57 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 Apr 28 04:57:57 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:57 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:57 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 is being set with open permissions: ugo+rw Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:57 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 Apr 28 04:57:57 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:57 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02" returned: 0 in 0.513s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:57 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c Apr 28 04:57:57 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:57 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378" returned: 0 in 0.480s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:57:57 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-73e48766-4183-485e-9ba1-545371c870f0 tempest-VolumesSnapshotListTestJSON-973749681 None] Create snapshot completed successfully Apr 28 04:57:58 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c" returned: 0 in 0.546s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:58 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c Apr 28 04:57:58 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:58 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02.5804c3bf-4bfc-4c01-9876-ecde5bf6692c" returned: 0 in 0.428s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-5804c3bf-4bfc-4c01-9876-ecde5bf6692c" released by "_delete_snapshot" :: held 2.149s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" released by "delete_snapshot" :: held 2.169s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-d8ad9560-a5f1-4d5e-bad5-02c35c968380" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ad9560-a5f1-4d5e-bad5-02c35c968380" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Deleting offline snapshot d8ad9560-a5f1-4d5e-bad5-02c35c968380 of volume b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] snapshot_file for this snap is: volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e722a-7ce5-45a1-8a0f-7d41a25e1526]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:58 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 Apr 28 04:57:58 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:59 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380" returned: 0 in 0.558s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a4f668-ff6b-4f10-9686-10f777da606e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca3c0c-c5b2-4022-aa5f-9c07d11c7b62]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:59 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e Apr 28 04:57:59 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-34d83e85-1d83-4964-ba44-9906a2e6b378-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-34d83e85-1d83-4964-ba44-9906a2e6b378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-34d83e85-1d83-4964-ba44-9906a2e6b378" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-34d83e85-1d83-4964-ba44-9906a2e6b378" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Deleting offline snapshot 34d83e85-1d83-4964-ba44-9906a2e6b378 of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] snapshot_file for this snap is: volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff276cee-7fb5-4e81-8c21-b0dd0517bee8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:59 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 Apr 28 04:57:59 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:57:59 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e" returned: 0 in 0.577s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:57:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:57:59 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 Apr 28 04:57:59 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:00 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378" returned: 0 in 0.521s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b42938-04b1-4422-89b3-780f6b9b3e33]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:00 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:58:00 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:00 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380" returned: 0 in 0.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:00 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380 Apr 28 04:58:00 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:00 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:00 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 Apr 28 04:58:00 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:00 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e.d8ad9560-a5f1-4d5e-bad5-02c35c968380" returned: 0 in 0.470s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-d8ad9560-a5f1-4d5e-bad5-02c35c968380" released by "_delete_snapshot" :: held 2.247s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" released by "delete_snapshot" :: held 2.271s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:00 devstack cinder-volume[82097]: WARNING cinder.quota [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1876382250 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1876382250, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:00 devstack cinder-volume[82097]: WARNING cinder.quota [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1876382250 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1876382250, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:00 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['8ef6dd63-4dea-4436-928a-58e9d5bd6d5d', '282eac00-9969-463c-9539-d04defdfdaf5', '3af3394d-56d1-4066-8db4-4eb8272425fb', 'e7379fa8-7293-4bf0-9887-3272867079a7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['d5f21144-956e-455c-b05e-d4263f960fb1', '2fbbcd81-af04-4374-aabb-c930bd9d2a49', '72eea107-c895-4298-aff3-dba80a7cc423', 'f212feec-c052-4118-acfe-4800149d9233'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:01 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a38e71c3-31a5-45cd-ac4f-aebeedc2beee tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 8f93694e-66f9-47e7-a1a3-19569d14c399: deleted successfully Apr 28 04:58:01 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378" returned: 0 in 0.659s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:01 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378 Apr 28 04:58:01 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:01 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.34d83e85-1d83-4964-ba44-9906a2e6b378" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-34d83e85-1d83-4964-ba44-9906a2e6b378" released by "_delete_snapshot" :: held 2.290s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" released by "delete_snapshot" :: held 2.314s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Created reservations ['2a2c6cbf-9016-4914-bc0c-118c034a14a5', 'e318353a-cf43-48f5-ac2f-9a77ab040e19', '867a85ad-3b84-4b0e-b4df-5e5c2f4fb55f', '3d89a512-e27f-4439-be0a-e9a22a830ea4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Delete snapshot completed successfully. Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e82ac59c-b316-448d-97bc-270940891ff1 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-34d83e85-1d83-4964-ba44-9906a2e6b378-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[821bd7c9-fe05-4df6-a8f6-94cf7d15cac3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:02 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e Apr 28 04:58:02 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:02 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e" returned: 0 in 0.537s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:02 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e Apr 28 04:58:02 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-4cad71fb-10ea-4153-9003-3f3ddcecc545-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-4cad71fb-10ea-4153-9003-3f3ddcecc545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-4cad71fb-10ea-4153-9003-3f3ddcecc545" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-4cad71fb-10ea-4153-9003-3f3ddcecc545" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Deleting offline snapshot 4cad71fb-10ea-4153-9003-3f3ddcecc545 of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] snapshot_file for this snap is: volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddad4d93-fd82-4c40-adb9-a28142524bef]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:02 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:58:02 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:03 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b3a4f668-ff6b-4f10-9686-10f777da606e" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-b3a4f668-ff6b-4f10-9686-10f777da606e" released by "delete_volume" :: held 1.112s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96bc30-5010-41d9-b759-85d374c1375f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:03 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 Apr 28 04:58:03 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:03 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.552s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db39fc3-9548-40aa-b618-e55f152f4486]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:03 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:58:03 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:03 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:03 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02 Apr 28 04:58:03 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:03 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.541s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:03 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:58:03 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:04 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fbc79d52-9b6b-4eff-a932-0b5586578a02" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-fbc79d52-9b6b-4eff-a932-0b5586578a02" released by "delete_volume" :: held 1.059s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['a168aa8b-5b56-42ae-8bc2-0df7e1f975f5'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:04 devstack cinder-volume[82097]: WARNING cinder.quota [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1876382250 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1876382250, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['284a21a5-7050-4108-abbc-b64f466acbf1', '4b8ba20a-9294-43e3-a8b0-28184f39bb7f', 'baf21c0b-7856-4ddc-82c4-3e021b301091', '5b50e596-131a-4ddf-b3e8-b5632db0fa86'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['fa983d97-7520-4d3c-a411-52c9bbf3e6c4', 'fd8dc850-dd39-45ea-a084-38226ba94dc5', '8b35d469-844f-4ec5-9e8d-23214a6e7df5', '553ea76b-62a1-450e-8293-5b98c1bd1756'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:04 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.668s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:04 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:04 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:04 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545 Apr 28 04:58:04 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:05 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.447s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-dca4b1fa-5132-4064-87ec-97cfdf9926c8 tempest-GroupSnapshotsTest-2132040142 None] Delete group completed successfully. Apr 28 04:58:05 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.4cad71fb-10ea-4153-9003-3f3ddcecc545" returned: 0 in 0.457s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-4cad71fb-10ea-4153-9003-3f3ddcecc545" released by "_delete_snapshot" :: held 2.314s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" released by "delete_snapshot" :: held 2.336s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Created reservations ['664bd5a9-0c82-4036-b09d-b7c6d2d4aa0b', '6edc62d0-7960-4546-af1b-ee1a8bd69bcc', 'bbe545c1-b50b-4834-8d21-2fb3615c5cb8', '15bd3a90-8a86-4fc3-a745-4d298c5bd475'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Delete snapshot completed successfully. Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-16658323-c387-4d36-ba81-7efd03a61359 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-4cad71fb-10ea-4153-9003-3f3ddcecc545-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8cd746d-e5b9-472d-90be-4e1dc3df170c tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-1265908618: creating Apr 28 04:58:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8cd746d-e5b9-472d-90be-4e1dc3df170c tempest-GroupSnapshotsTest-2132040142 None] Group tempest-GroupSnapshotsTest-Group-1265908618: created successfully Apr 28 04:58:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d8cd746d-e5b9-472d-90be-4e1dc3df170c tempest-GroupSnapshotsTest-2132040142 None] Create group completed successfully. Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-0837bb26-c052-49ef-bc44-20a8c20d5d3b-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-0837bb26-c052-49ef-bc44-20a8c20d5d3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-0837bb26-c052-49ef-bc44-20a8c20d5d3b" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0837bb26-c052-49ef-bc44-20a8c20d5d3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Deleting offline snapshot 0837bb26-c052-49ef-bc44-20a8c20d5d3b of volume 0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] snapshot_file for this snap is: volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79c2a8-d207-45b9-bb9d-3151c1da66d2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:06 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:58:06 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:06 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.534s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a040e15-5030-4b82-9428-a81e848f4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7c0dc-08f4-406f-a151-ec78a8802924]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:06 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e Apr 28 04:58:06 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:07 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e" returned: 0 in 0.624s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:07 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:58:07 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (5916f21b-e4e6-4f77-a7ae-8b26ce0af34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ad54c-e438-4e1c-91aa-016514105d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ad54c-e438-4e1c-91aa-016514105d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359669300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3caa55e5-c217-4359-b9d2-716114bd799e,host='devstack@QuobyteHD#QuobyteHD',id=e91a8a2b-9805-45bf-9189-5af02bfd2cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:07Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6368b63-b637-4b60-994f-91dc31b2f3f5),volume_type_id=d6368b63-b637-4b60-994f-91dc31b2f3f5)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f18eb-9c17-4e1e-aa8c-ac00beb05d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507f18eb-9c17-4e1e-aa8c-ac00beb05d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964385c1-4a31-48ba-8b33-1e7f26b91ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964385c1-4a31-48ba-8b33-1e7f26b91ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91a8a2b-9805-45bf-9189-5af02bfd2cdd', 'volume_name': 'volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3c3483-46dd-40ec-8cea-2e968c4f9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3c3483-46dd-40ec-8cea-2e968c4f9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458fb44e-1a67-4822-ae07-2d23f2d16a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:07 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Volume e91a8a2b-9805-45bf-9189-5af02bfd2cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd', 'volume_size': 1} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3caa55e5-c217-4359-b9d2-716114bd799e,created_at=2026-04-28T02:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359669300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3caa55e5-c217-4359-b9d2-716114bd799e,host='devstack@QuobyteHD#QuobyteHD',id=e91a8a2b-9805-45bf-9189-5af02bfd2cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94319b7250b7474393d5c2f80cca23c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:07Z,use_quota=True,user_id='163576dbc1a644118265be0e565f519b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6368b63-b637-4b60-994f-91dc31b2f3f5),volume_type_id=d6368b63-b637-4b60-994f-91dc31b2f3f5)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Creating volume e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:07 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:07 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd 1073741824 Apr 28 04:58:07 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:07 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.519s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:07 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b Apr 28 04:58:07 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:07 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd 1073741824" returned: 0 in 0.626s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:07 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd Apr 28 04:58:07 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:08 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e.0837bb26-c052-49ef-bc44-20a8c20d5d3b" returned: 0 in 0.465s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0837bb26-c052-49ef-bc44-20a8c20d5d3b" released by "_delete_snapshot" :: held 2.251s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" released by "delete_snapshot" :: held 2.271s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Created reservations ['6dd19ae2-a745-48b2-b3fb-34bbf466935b', '8d110859-ef7d-48ba-8a09-0bc10f5f2c1c', '3bcf23b6-2630-47d2-a3f0-6fb95b61774a', '6233c998-17c3-4fab-a7cc-98eef006d213'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Delete snapshot completed successfully. Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-fb8100ec-ebea-4246-80e6-88f908141b1f tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-0837bb26-c052-49ef-bc44-20a8c20d5d3b-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:08 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" returned: 0 in 0.479s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458fb44e-1a67-4822-ae07-2d23f2d16a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d19b48d-4d31-4326-aed6-1596fd3e25b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:08 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Volume volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd (e91a8a2b-9805-45bf-9189-5af02bfd2cdd): created successfully Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d19b48d-4d31-4326-aed6-1596fd3e25b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:08 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Flow 'volume_create_manager' (5916f21b-e4e6-4f77-a7ae-8b26ce0af34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-402affc1-d3ac-4b79-9f54-ed077ad10ac1 tempest-GroupSnapshotsTest-2132040142 None] Created volume successfully. Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-0a040e15-5030-4b82-9428-a81e848f4d8e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-0a040e15-5030-4b82-9428-a81e848f4d8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab474d7-ecda-4f98-961b-5393c977334c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:09 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e Apr 28 04:58:09 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:09 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] GroupSnapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: creating. Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Group snapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: creating. {{(pid=82097) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Creating offline snapshot 11510cf6-0de8-4964-ad5b-7ade882844d1 of volume e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ecc2c-8c8b-4e4c-b99e-ab09ac800fff]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:09 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd Apr 28 04:58:09 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:09 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:09 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e Apr 28 04:58:09 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:10 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" returned: 0 in 0.520s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:10 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 1G Apr 28 04:58:10 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:10 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a040e15-5030-4b82-9428-a81e848f4d8e" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-quobyte-0a040e15-5030-4b82-9428-a81e848f4d8e" released by "delete_volume" :: held 1.086s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Created reservations ['69e2883b-2333-4f35-b5aa-29671b26da91', '62f4ca21-eaf3-4456-b7c5-0ea20f9ca996', '15b66190-fb47-47ab-84e5-b59128619a5e', '1690741d-56da-4adc-846a-528ffae6b0a3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:10 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:10 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:10 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 1G" returned: 0 in 0.615s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:10 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 Apr 28 04:58:10 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:10 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:10 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Deleted volume successfully. Apr 28 04:58:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-88660de9-6ad1-4c9e-8632-6425e0c283f6 tempest-VolumesSnapshotListTestJSON-973749681 None] Lock "cinder-0a040e15-5030-4b82-9428-a81e848f4d8e-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:11 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1" returned: 0 in 0.502s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:11 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:58:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:11 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 Apr 28 04:58:11 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:11 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1" returned: 0 in 0.487s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:11 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info Apr 28 04:58:11 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:12 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info" returned: 0 in 0.508s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:12 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:58:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:12 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info Apr 28 04:58:12 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:12 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.info" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:12 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=168,cinder:INSERT=49,cinder:UPDATE=201,cinder:DELETE=9 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:58:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-09b547bc-0a75-4e03-9a3e-c5dbb453c403 tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: created successfully Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:INSERT=46,cinder:UPDATE=182,cinder:SELECT=176,cinder:DELETE=12 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (324c4c2c-624f-4e62-b1ab-fab5ade406c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c3fe0e-f0c2-47a1-b485-f9487217f0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c3fe0e-f0c2-47a1-b485-f9487217f0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177817722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0882da05-8166-4f46-839d-5b308a73f101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:14Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369b7f05-844a-4136-b3e6-a9a553af0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369b7f05-844a-4136-b3e6-a9a553af0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c00090-a724-4ef9-9c33-3ed8fc882962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c00090-a724-4ef9-9c33-3ed8fc882962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0882da05-8166-4f46-839d-5b308a73f101', 'volume_name': 'volume-0882da05-8166-4f46-839d-5b308a73f101', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f090b7f-1a2b-4f95-8642-d2609a601e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f090b7f-1a2b-4f95-8642-d2609a601e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b4739e-5c2a-4366-a12a-488e43bf960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:13 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Volume 0882da05-8166-4f46-839d-5b308a73f101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0882da05-8166-4f46-839d-5b308a73f101', 'volume_size': 1} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177817722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0882da05-8166-4f46-839d-5b308a73f101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:14Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Creating volume 0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:13 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: deleting Apr 28 04:58:13 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 1073741824 Apr 28 04:58:13 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: deleting {{(pid=82097) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-11510cf6-0de8-4964-ad5b-7ade882844d1" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-11510cf6-0de8-4964-ad5b-7ade882844d1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Deleting offline snapshot 11510cf6-0de8-4964-ad5b-7ade882844d1 of volume e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] snapshot_file for this snap is: volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad7b1b-c3aa-4eb5-a317-0733968c4eaa]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:14 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 Apr 28 04:58:14 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:14 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 1073741824" returned: 0 in 0.692s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:14 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1" returned: 0 in 0.585s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:14 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:14 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b1c083-788b-41bd-8f8f-a12ca9decf11]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:14 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd Apr 28 04:58:14 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:15 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b4739e-5c2a-4366-a12a-488e43bf960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0882da05-8166-4f46-839d-5b308a73f101', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5b1374-e63f-4d13-8eb2-bc0bf43d4786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Volume volume-0882da05-8166-4f46-839d-5b308a73f101 (0882da05-8166-4f46-839d-5b308a73f101): created successfully Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5b1374-e63f-4d13-8eb2-bc0bf43d4786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (324c4c2c-624f-4e62-b1ab-fab5ade406c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-24af2c93-91ca-4c00-9dc7-e0b22fbabf57 tempest-VolumeDependencyTests-819519062 None] Created volume successfully. Apr 28 04:58:15 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" returned: 0 in 0.548s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:15 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 Apr 28 04:58:15 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:15 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:15 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1 Apr 28 04:58:15 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Creating offline snapshot 08bcd400-def7-414d-8b62-a0d22c1ee19a of volume 0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[276bb95a-1b48-4abc-8e61-48e7b12c29b1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:16 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:16 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:16 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd.11510cf6-0de8-4964-ad5b-7ade882844d1" returned: 0 in 0.479s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-11510cf6-0de8-4964-ad5b-7ade882844d1" released by "_delete_snapshot" :: held 2.256s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" released by "delete_snapshot" :: held 2.278s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:16 devstack cinder-volume[82097]: WARNING cinder.quota [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-396271584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-396271584, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:16 devstack cinder-volume[82097]: WARNING cinder.quota [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-396271584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-396271584, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['f518b60b-639d-4ce2-905c-94e164d099f0', '4eed950e-fcc4-4625-a9a9-6ffdbc754c7a', '364e3564-cf9d-4aff-9420-b29df642c94f', 'd98129c2-8624-4d16-b2d0-fa3a5d0c6587'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2a0dc706-82df-464f-bcef-48c0e270f99c tempest-GroupSnapshotsTest-2132040142 None] group_snapshot 573b10b8-abf7-44f5-a351-1ec9529d279f: deleted successfully Apr 28 04:58:16 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.549s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:16 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a 1G Apr 28 04:58:16 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:17 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a 1G" returned: 0 in 0.617s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0882da05-8166-4f46-839d-5b308a73f101 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:17 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0882da05-8166-4f46-839d-5b308a73f101 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:17 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f25c8-38c5-4b4a-906e-5069f40de279]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:17 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd Apr 28 04:58:17 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:17 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0882da05-8166-4f46-839d-5b308a73f101 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.492s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:17 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a is being set with open permissions: ugo+rw Apr 28 04:58:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:17 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:17 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:18 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" returned: 0 in 0.527s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:18 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd Apr 28 04:58:18 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:18 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.440s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:18 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info Apr 28 04:58:18 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:18 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Lock "cinder-quobyte-e91a8a2b-9805-45bf-9189-5af02bfd2cdd" released by "delete_volume" :: held 1.028s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['06c11918-7d71-4e66-b5b9-57e5d9d6a590'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:18 devstack cinder-volume[82097]: WARNING cinder.quota [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-396271584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-396271584, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Created reservations ['1a628a47-1d88-4711-9259-1500e81cbd1d', '5e8b5425-fe2a-481e-803d-9b138aab7f2f', 'da9cf706-089c-49da-8b38-f72a6f0453f8', 'cc543dc6-bf63-429a-b340-533c6f53078a'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:18 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:18 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:18 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:18 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info is being set with open permissions: ugo+rw Apr 28 04:58:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:18 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info Apr 28 04:58:18 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:19 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.420s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:19 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e0be4a3c-a06d-4523-aedc-a2effdf2085a tempest-GroupSnapshotsTest-2132040142 None] Delete group completed successfully. Apr 28 04:58:19 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.info" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b8ea5573-2149-48ff-ac71-c4a43503af7a tempest-VolumeDependencyTests-819519062 None] Create snapshot completed successfully Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (44a3330f-5ea1-4953-b0b8-cbffa790a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9512c96c-8716-4744-82bd-ed1f26fbb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9512c96c-8716-4744-82bd-ed1f26fbb824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-487197925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92293a1-7432-4441-b4e5-d78a425cd3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08bcd400-def7-414d-8b62-a0d22c1ee19a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:21Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6217f972-ebcb-4d8c-9cd9-1cd2c46259d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6217f972-ebcb-4d8c-9cd9-1cd2c46259d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c40350d-27b9-4785-8941-907bf50e684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c40350d-27b9-4785-8941-907bf50e684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e92293a1-7432-4441-b4e5-d78a425cd3fb', 'volume_name': 'volume-e92293a1-7432-4441-b4e5-d78a425cd3fb', 'volume_size': 1, 'snapshot_id': '08bcd400-def7-414d-8b62-a0d22c1ee19a'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e1ebb0-9600-4d5b-86da-2760a89af366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e1ebb0-9600-4d5b-86da-2760a89af366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7566f635-a64b-41b3-9401-0175eaa738e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Volume e92293a1-7432-4441-b4e5-d78a425cd3fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e92293a1-7432-4441-b4e5-d78a425cd3fb', 'volume_size': 1, 'snapshot_id': '08bcd400-def7-414d-8b62-a0d22c1ee19a'} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a-e92293a1-7432-4441-b4e5-d78a425cd3fb" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a-e92293a1-7432-4441-b4e5-d78a425cd3fb" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Creating volume e92293a1-7432-4441-b4e5-d78a425cd3fb from snapshot 08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] snapshot: 08bcd400-def7-414d-8b62-a0d22c1ee19a, volume: e92293a1-7432-4441-b4e5-d78a425cd3fb, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276d1a3-7719-4f52-9385-c5cba01313e9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:21 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:21 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:21 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.618s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0882da05-8166-4f46-839d-5b308a73f101(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae429d2-0797-489b-b72d-2e4030213fa9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:21 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:21 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:22 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.587s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:22 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:58:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:22 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb Apr 28 04:58:22 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c06c8c4b-abeb-463e-963a-9e12e8281401 tempest-GroupsV314Test-1060503959 None] Group tempest-GroupsV314Test-Group-1180947538: creating Apr 28 04:58:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c06c8c4b-abeb-463e-963a-9e12e8281401 tempest-GroupsV314Test-1060503959 None] Group tempest-GroupsV314Test-Group-1180947538: created successfully Apr 28 04:58:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c06c8c4b-abeb-463e-963a-9e12e8281401 tempest-GroupsV314Test-1060503959 None] Create group completed successfully. Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Flow 'volume_create_manager' (9a1919ba-f06a-4e6f-8113-d73b25c717ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e2fa9-061e-426b-be1b-9b2e8ae816cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e2fa9-061e-426b-be1b-9b2e8ae816cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894196318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b3c7e0e-7ee9-4556-aded-acd5096b049a,host='devstack@QuobyteHD#QuobyteHD',id=99fe7c46-efc9-4fab-bca8-4b1252b177fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21361fefeb645f3b496904158e83a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:27Z,use_quota=True,user_id='1f75b4161abb46c583bc0753759ca3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302c27dc-e2df-4958-a6a0-21eb5025a6e1),volume_type_id=302c27dc-e2df-4958-a6a0-21eb5025a6e1)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feedc993-1435-45ee-9126-d941e3c2fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feedc993-1435-45ee-9126-d941e3c2fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476c453d-56e1-48d3-b3a1-cc14dee86722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476c453d-56e1-48d3-b3a1-cc14dee86722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fe7c46-efc9-4fab-bca8-4b1252b177fd', 'volume_name': 'volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce00a8-6fdc-4b25-837d-3866b50003c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce00a8-6fdc-4b25-837d-3866b50003c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7439f3-f0cc-44a3-a3e3-8a1c5e762a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Volume 99fe7c46-efc9-4fab-bca8-4b1252b177fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd', 'volume_size': 1} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:27 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb" returned: 0 in 5.360s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ae8bc-9870-4c65-8c36-dd223e646785]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:27 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:27 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:28 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.632s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:58:28 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Converted 1024.00 MB image at 190.98 MB/s Apr 28 04:58:28 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb is being set with open permissions: ugo+rw Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:28 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb Apr 28 04:58:28 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:28 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb" returned: 0 in 0.455s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" released by "_copy_volume_from_snapshot" :: held 7.766s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a-e92293a1-7432-4441-b4e5-d78a425cd3fb" released by "_create_volume_from_snapshot" :: held 7.793s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.808s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b3c7e0e-7ee9-4556-aded-acd5096b049a,created_at=2026-04-28T02:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894196318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b3c7e0e-7ee9-4556-aded-acd5096b049a,host='devstack@QuobyteHD#QuobyteHD',id=99fe7c46-efc9-4fab-bca8-4b1252b177fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21361fefeb645f3b496904158e83a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:27Z,use_quota=True,user_id='1f75b4161abb46c583bc0753759ca3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(302c27dc-e2df-4958-a6a0-21eb5025a6e1),volume_type_id=302c27dc-e2df-4958-a6a0-21eb5025a6e1)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Creating volume 99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:28 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:28 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd 1073741824 Apr 28 04:58:28 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7566f635-a64b-41b3-9401-0175eaa738e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92293a1-7432-4441-b4e5-d78a425cd3fb', 'volume_size': 1, 'snapshot_id': '08bcd400-def7-414d-8b62-a0d22c1ee19a'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa04bbb-6ba9-4b8a-92fa-075decacff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:28 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Volume volume-e92293a1-7432-4441-b4e5-d78a425cd3fb (e92293a1-7432-4441-b4e5-d78a425cd3fb): created successfully Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa04bbb-6ba9-4b8a-92fa-075decacff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (44a3330f-5ea1-4953-b0b8-cbffa790a10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-352b2bc5-3b40-4a82-a710-64367d7c7378 tempest-VolumeDependencyTests-819519062 None] Created volume successfully. Apr 28 04:58:29 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd 1073741824" returned: 0 in 0.603s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:29 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:29 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-08bcd400-def7-414d-8b62-a0d22c1ee19a-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-08bcd400-def7-414d-8b62-a0d22c1ee19a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Deleting offline snapshot 08bcd400-def7-414d-8b62-a0d22c1ee19a of volume 0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] snapshot_file for this snap is: volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22d3b0d-ce04-4263-910b-adb9801234bd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:29 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:29 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:29 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.479s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7439f3-f0cc-44a3-a3e3-8a1c5e762a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6db9631-fa40-45ec-a683-749446154d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Volume volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd (99fe7c46-efc9-4fab-bca8-4b1252b177fd): created successfully Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6db9631-fa40-45ec-a683-749446154d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Flow 'volume_create_manager' (9a1919ba-f06a-4e6f-8113-d73b25c717ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5807249b-8df7-4494-aadb-ea1b6182a2ce tempest-GroupsV314Test-1060503959 None] Created volume successfully. Apr 28 04:58:30 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.514s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0882da05-8166-4f46-839d-5b308a73f101(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc12c44-8cda-479b-8cd4-deb1cee9049b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:30 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:30 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:30 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.560s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:30 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:30 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:31 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:31 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a Apr 28 04:58:31 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:31 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Cloning volume 99fe7c46-efc9-4fab-bca8-4b1252b177fd to volume c1cdcba2-8d2c-4278-91d2-78ad292484aa Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Creating offline snapshot fcecf652-7d62-466f-8bac-bbee05336651 of volume 99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[349427be-edee-4fd0-a668-5af7af362e20]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:31 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:31 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:31 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101.08bcd400-def7-414d-8b62-a0d22c1ee19a" returned: 0 in 0.467s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-08bcd400-def7-414d-8b62-a0d22c1ee19a" released by "_delete_snapshot" :: held 2.175s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" released by "delete_snapshot" :: held 2.199s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Created reservations ['1181e55a-b394-4396-a196-0d33d9888796', 'dc6769a0-8d56-4eb1-befe-e69d6152559e', '848486ee-4fc6-40bf-a0d6-b6504df99fc6', 'fc56237c-e3e3-463d-a91f-54f3e7d38844'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Delete snapshot completed successfully. Apr 28 04:58:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6b011459-ad5d-4ba2-92ff-71691e1d48cb tempest-VolumeDependencyTests-819519062 None] Lock "cinder-08bcd400-def7-414d-8b62-a0d22c1ee19a-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:32 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.566s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:32 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 1G Apr 28 04:58:32 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-0882da05-8166-4f46-839d-5b308a73f101-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "cinder-0882da05-8166-4f46-839d-5b308a73f101-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:32 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 1G" returned: 0 in 0.612s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:32 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:32 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb51918-beca-4131-9c38-0258a60c252b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:33 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:33 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:33 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.512s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:33 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:33 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:33 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:33 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.529s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:33 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101 Apr 28 04:58:33 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:33 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.451s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:33 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info Apr 28 04:58:33 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:33 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0882da05-8166-4f46-839d-5b308a73f101" returned: 0 in 0.458s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0882da05-8166-4f46-839d-5b308a73f101" released by "delete_volume" :: held 1.043s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:33 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Created reservations ['983478dc-0aa8-4b12-ac18-09aab2a106ec', '75af636d-a7e8-4a11-af50-29b570d61ff6', '6bf1894a-6daa-4a5c-afb3-ed7505271131', 'e0e97506-c651-4790-bc78-1c6aeb0f7c96'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:34 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:34 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:34 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info" returned: 0 in 0.499s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:34 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:34 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info Apr 28 04:58:34 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:34 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.426s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Deleted volume successfully. Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7c525853-bf3e-4d77-a0e3-2350431c9e5c tempest-VolumeDependencyTests-819519062 None] Lock "cinder-0882da05-8166-4f46-839d-5b308a73f101-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:34 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.info" returned: 0 in 0.428s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Acquiring lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] snapshot: fcecf652-7d62-466f-8bac-bbee05336651, volume: c1cdcba2-8d2c-4278-91d2-78ad292484aa, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c9eba8-8cc0-4c1a-b365-41df5bd3e1f9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:34 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:34 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (2aa8e72b-0672-4926-950e-f8c9af495d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdedc28b-d8f9-4911-9d20-b6eba4d20d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdedc28b-d8f9-4911-9d20-b6eba4d20d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2053528739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbf7031-3782-4e0c-af10-dea942736acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:35Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47323548-8d3c-41a1-85fb-835af35626ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47323548-8d3c-41a1-85fb-835af35626ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e165c30-50b2-43a7-bd6d-1458e0a60619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e165c30-50b2-43a7-bd6d-1458e0a60619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbf7031-3782-4e0c-af10-dea942736acf', 'volume_name': 'volume-0dbf7031-3782-4e0c-af10-dea942736acf', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac9a83-50ff-408e-911a-b629eb4ef6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac9a83-50ff-408e-911a-b629eb4ef6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c5a083-436b-449e-925c-2f4332c0e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:35 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Volume 0dbf7031-3782-4e0c-af10-dea942736acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbf7031-3782-4e0c-af10-dea942736acf', 'volume_size': 1} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:35 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.565s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e7dd88-687a-471f-b7c2-59830c07ed25]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:35 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:35 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:35 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.492s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:58:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:35 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa Apr 28 04:58:35 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:40 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa" returned: 0 in 4.735s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:40 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2851278-607e-4e15-b69a-e37105dead3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:40 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:40 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:41 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.651s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:58:41 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Converted 1024.00 MB image at 216.21 MB/s Apr 28 04:58:41 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa is being set with open permissions: ugo+rw: NotImplementedError Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:41 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa Apr 28 04:58:41 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:41 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa" returned: 0 in 0.433s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" released by "_copy_volume_from_snapshot" :: held 6.949s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Acquiring lock "cinder-quobyte-fcecf652-7d62-466f-8bac-bbee05336651" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-fcecf652-7d62-466f-8bac-bbee05336651" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Deleting offline snapshot fcecf652-7d62-466f-8bac-bbee05336651 of volume 99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] snapshot_file for this snap is: volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b1c2b-42db-45e8-af56-bd0a6f0655b0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:41 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:41 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:42 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2daadc-732b-4479-9303-f8031d43bc97]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:42 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:42 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:42 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.516s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:42 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:42 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:43 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.552s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:43 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651 Apr 28 04:58:43 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:43 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd.fcecf652-7d62-466f-8bac-bbee05336651" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-fcecf652-7d62-466f-8bac-bbee05336651" released by "_delete_snapshot" :: held 2.107s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.291s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.523s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2053528739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbf7031-3782-4e0c-af10-dea942736acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:35Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Creating volume 0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:43 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:58:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:43 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf 1073741824 Apr 28 04:58:43 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-71cad03d-5cc4-4018-82d4-8f16c4761f92 tempest-GroupsV314Test-1060503959 None] Create group from source-group-2b3c7e0e-7ee9-4556-aded-acd5096b049a completed successfully. Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Acquiring lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4384bff5-3c30-4f45-bd0f-757a273b88c3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:44 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa Apr 28 04:58:44 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:44 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf 1073741824" returned: 0 in 0.675s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:44 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:58:44 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:44 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa" returned: 0 in 0.540s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:45 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa Apr 28 04:58:45 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:45 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c5a083-436b-449e-925c-2f4332c0e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbf7031-3782-4e0c-af10-dea942736acf', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea7928-b66e-4181-9bc0-f7520ce1b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:45 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Volume volume-0dbf7031-3782-4e0c-af10-dea942736acf (0dbf7031-3782-4e0c-af10-dea942736acf): created successfully Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea7928-b66e-4181-9bc0-f7520ce1b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (2aa8e72b-0672-4926-950e-f8c9af495d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bbe60075-a716-4f4b-91da-cf29586c0ccd tempest-VolumeDependencyTests-819519062 None] Created volume successfully. Apr 28 04:58:45 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c1cdcba2-8d2c-4278-91d2-78ad292484aa" returned: 0 in 0.465s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-c1cdcba2-8d2c-4278-91d2-78ad292484aa" released by "delete_volume" :: held 1.051s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Created reservations ['97dbd204-5b9d-44c3-a42b-99189fcde8e9'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:45 devstack cinder-volume[82097]: WARNING cinder.quota [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-655483068 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-655483068, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:45 devstack cinder-volume[82097]: WARNING cinder.quota [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-655483068 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-655483068, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Created reservations ['227abd09-6317-45be-8765-22a9662388b9', 'd3da7046-dd69-4243-8bdc-fe7b471300ab', '0f64be0d-990d-45ff-8003-23b07960fc9d', 'fc992971-91ef-4781-a7ad-9f0b4cbb232b'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:45 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:45 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:46 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9be6734e-3649-4b37-b43b-5d0066f70da8 tempest-GroupsV314Test-1060503959 None] Delete group completed successfully. Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (57ef12ec-f583-4ad7-b15a-de6798bcd0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3d4ba8-5cab-4785-951f-164170c75739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3d4ba8-5cab-4785-951f-164170c75739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1424516120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd335fa-8382-46f1-b391-3c521603799f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61edb6248bf475598f271638ecab117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0dbf7031-3782-4e0c-af10-dea942736acf,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:46Z,use_quota=True,user_id='4a30239ad7804116931d8fe09eccd82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c19c796-d2b3-4ff7-b02b-6978ddc27954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c19c796-d2b3-4ff7-b02b-6978ddc27954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a4fd6-8316-4bec-b4b8-9a09ae67b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a4fd6-8316-4bec-b4b8-9a09ae67b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1fd335fa-8382-46f1-b391-3c521603799f', 'volume_name': 'volume-1fd335fa-8382-46f1-b391-3c521603799f', 'volume_size': 1, 'source_volid': '0dbf7031-3782-4e0c-af10-dea942736acf', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af39d48-30c9-4049-b42a-dbf99235a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af39d48-30c9-4049-b42a-dbf99235a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02d15e-7d77-46ad-9953-9657c9bfcb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Volume 1fd335fa-8382-46f1-b391-3c521603799f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1fd335fa-8382-46f1-b391-3c521603799f', 'volume_size': 1, 'source_volid': '0dbf7031-3782-4e0c-af10-dea942736acf', 'source_volstatus': 'available'} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:46 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Cloning volume 0dbf7031-3782-4e0c-af10-dea942736acf to volume 1fd335fa-8382-46f1-b391-3c521603799f Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Creating offline snapshot 2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 of volume 0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c855051-3063-41e5-b77a-4a700a115371]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:46 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:58:46 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Acquiring lock "cinder-quobyte-99fe7c46-efc9-4fab-bca8-4b1252b177fd" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-99fe7c46-efc9-4fab-bca8-4b1252b177fd" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247ebe5-99ea-458a-a83f-ca50005b9486]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:46 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:46 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:47 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.577s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:47 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 1G Apr 28 04:58:47 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:47 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.522s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:47 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd Apr 28 04:58:47 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:47 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 1G" returned: 0 in 0.620s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbf7031-3782-4e0c-af10-dea942736acf -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:47 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbf7031-3782-4e0c-af10-dea942736acf -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:47 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:47 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-99fe7c46-efc9-4fab-bca8-4b1252b177fd" returned: 0 in 0.481s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Lock "cinder-quobyte-99fe7c46-efc9-4fab-bca8-4b1252b177fd" released by "delete_volume" :: held 1.095s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Created reservations ['b06f2d85-684b-42f7-9b5d-97e69a831d54'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Created reservations ['cde0d95e-3bd2-4060-988b-0062d4dd0497', '04c86fe8-e8a3-4120-85fa-b2f34e012a9c', 'b4bc5f51-0bbb-425f-a3a2-6c95573f1633', '73b66469-72bb-48cf-9597-af89f3dd2a23'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:48 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:48 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:48 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbf7031-3782-4e0c-af10-dea942736acf -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:48 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 is being set with open permissions: ugo+rw Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:48 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:48 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:48 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.455s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7dd353d3-ca3f-4308-b310-31924e0721ec tempest-GroupsV314Test-1060503959 None] Delete group completed successfully. Apr 28 04:58:48 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:48 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info Apr 28 04:58:48 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:49 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info" returned: 0 in 0.462s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:49 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info is being set with open permissions: ugo+rw Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:49 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info Apr 28 04:58:49 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:49 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.info" returned: 0 in 0.461s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] snapshot: 2982ba74-d6ad-406c-b3ab-4cb69e1af8a4, volume: 1fd335fa-8382-46f1-b391-3c521603799f, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3baaa44-a136-4fb4-b086-db5cadeb848d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:49 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:49 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:50 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.577s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbf7031-3782-4e0c-af10-dea942736acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9a308f-3d48-4557-b6a9-3579dfb50773]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:50 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:58:50 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:50 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.638s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:51 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 04:58:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:51 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f Apr 28 04:58:51 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Flow 'volume_create_manager' (a5f0e97b-41d3-4a55-b4e9-cd8c5d77ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6354919c-3a02-41f5-a44d-b6490ff53497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6354919c-3a02-41f5-a44d-b6490ff53497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2102207533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbb8361-90d6-441b-a9bf-67afd2d1972d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1bc14b8b554581b298033efc955329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:56Z,use_quota=True,user_id='8ca65fd392784720abdd5c8e69b99b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1211a58c-a297-49a6-baf3-7feebaab0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1211a58c-a297-49a6-baf3-7feebaab0acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39724d2b-3ea7-4b90-9b59-25b6b2484a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39724d2b-3ea7-4b90-9b59-25b6b2484a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbb8361-90d6-441b-a9bf-67afd2d1972d', 'volume_name': 'volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a74f07-11ac-4b4f-a6ed-a982cd656324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a74f07-11ac-4b4f-a6ed-a982cd656324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8515a90c-2528-4c1b-b2ab-a2efc382a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d', 'volume_size': 1} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:56 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f" returned: 0 in 5.214s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a3248-d51d-4053-b64a-263f1e805c3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:56 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:58:56 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:56 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:58:56 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:56 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.642s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 04:58:56 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Converted 1024.00 MB image at 196.36 MB/s Apr 28 04:58:56 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f is being set with open permissions: ugo+rw Apr 28 04:58:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:56 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f Apr 28 04:58:56 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:57 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:58:57 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" released by "_copy_volume_from_snapshot" :: held 7.600s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Deleting offline snapshot 2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 of volume 0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] snapshot_file for this snap is: volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e79e9-0009-4838-934c-2c2fc55c09c8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:57 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:57 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:57 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbf7031-3782-4e0c-af10-dea942736acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d8965-d046-4cfe-a69c-be7310b96d60]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:58:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:58 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:58:58 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:58 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.531s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:58 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:58 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:58 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.534s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:59 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4 Apr 28 04:58:59 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:59 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf.2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" returned: 0 in 0.461s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-2982ba74-d6ad-406c-b3ab-4cb69e1af8a4" released by "_delete_snapshot" :: held 2.121s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.976s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.334s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2102207533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbb8361-90d6-441b-a9bf-67afd2d1972d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1bc14b8b554581b298033efc955329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:58:56Z,use_quota=True,user_id='8ca65fd392784720abdd5c8e69b99b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Creating volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:58:59 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02d15e-7d77-46ad-9953-9657c9bfcb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd335fa-8382-46f1-b391-3c521603799f', 'volume_size': 1, 'source_volid': '0dbf7031-3782-4e0c-af10-dea942736acf', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:59 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d 1073741824 Apr 28 04:58:59 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41638573-79cf-4825-a873-8c8a7445af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:58:59 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Volume volume-1fd335fa-8382-46f1-b391-3c521603799f (1fd335fa-8382-46f1-b391-3c521603799f): created successfully Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41638573-79cf-4825-a873-8c8a7445af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:58:59 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Flow 'volume_create_manager' (57ef12ec-f583-4ad7-b15a-de6798bcd0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:58:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-539ba343-15f0-48e3-8e6b-a7bb39caf4e6 tempest-VolumeDependencyTests-819519062 None] Created volume successfully. Apr 28 04:59:00 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d 1073741824" returned: 0 in 0.603s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:00 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d Apr 28 04:59:00 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-0dbf7031-3782-4e0c-af10-dea942736acf-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-0dbf7031-3782-4e0c-af10-dea942736acf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-0dbf7031-3782-4e0c-af10-dea942736acf" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0dbf7031-3782-4e0c-af10-dea942736acf" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64132c-e7d8-4105-b398-24a574234b3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:00 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d" returned: 0 in 0.480s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8515a90c-2528-4c1b-b2ab-a2efc382a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4567094f-4edf-45e1-bbc1-c394cf433868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:00 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Volume volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d (4bbb8361-90d6-441b-a9bf-67afd2d1972d): created successfully Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4567094f-4edf-45e1-bbc1-c394cf433868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Flow 'volume_create_manager' (a5f0e97b-41d3-4a55-b4e9-cd8c5d77ff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-dec5d421-68fb-4b0d-9dd8-5de4d8c6888b tempest-SnapshotsActionsTest-1453799112 None] Created volume successfully. Apr 28 04:59:00 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:59:00 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:01 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.512s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:01 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf Apr 28 04:59:01 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Creating offline snapshot 4834e292-1496-4061-96c2-a3b644e8a4e3 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c1347-6aca-48bc-83c2-344d1fce2751]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:01 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d Apr 28 04:59:01 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:01 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0dbf7031-3782-4e0c-af10-dea942736acf" returned: 0 in 0.474s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-0dbf7031-3782-4e0c-af10-dea942736acf" released by "delete_volume" :: held 1.039s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Created reservations ['3ddf3689-30d9-484d-83b0-c22dba40205a', '0e2a5824-f4fb-4cf0-bf95-a2da0af77b42', '1caf68a7-f097-4422-828b-1d0a61030299', '5996de91-353d-4df1-8c81-a27982a4e0e7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:01 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:01 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:02 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d" returned: 0 in 0.549s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:02 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 1G Apr 28 04:59:02 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:02 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.448s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Deleted volume successfully. Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cd4c931d-635c-4b4f-9957-48c293d30c61 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-0dbf7031-3782-4e0c-af10-dea942736acf-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:02 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 1G" returned: 0 in 0.584s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:02 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:02 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-1fd335fa-8382-46f1-b391-3c521603799f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-1fd335fa-8382-46f1-b391-3c521603799f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e0b81-dc7a-46e1-a9fc-299300915ccb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:02 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f Apr 28 04:59:02 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:03 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:03 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 is being set with open permissions: ugo+rw Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:03 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:03 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:03 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f" returned: 0 in 0.548s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:03 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f Apr 28 04:59:03 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:03 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.495s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:03 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info Apr 28 04:59:03 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:03 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1fd335fa-8382-46f1-b391-3c521603799f" returned: 0 in 0.458s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-1fd335fa-8382-46f1-b391-3c521603799f" released by "delete_volume" :: held 1.057s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:03 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Created reservations ['b8ce15b5-3ec3-40bd-85ad-b225963e3bae', '58c5f9b8-174e-4c61-bb17-0278d8e0d1fe', '3ea8d2f3-5641-494a-a6c5-8144f75bd834', '563aba69-8106-4abc-b960-c0ac4c058c83'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:04 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:04 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:04 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info" returned: 0 in 0.482s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:04 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info is being set with open permissions: ugo+rw Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:04 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info Apr 28 04:59:04 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:04 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Deleted volume successfully. Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2e5834ab-535e-4e36-aa93-161fa2465d73 tempest-VolumeDependencyTests-819519062 None] Lock "cinder-1fd335fa-8382-46f1-b391-3c521603799f-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:04 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.info" returned: 0 in 0.489s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-01b8e48e-1d35-4d71-af23-dcd6fd980790 tempest-SnapshotsActionsTest-1453799112 None] Create snapshot completed successfully Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-e92293a1-7432-4441-b4e5-d78a425cd3fb-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "cinder-e92293a1-7432-4441-b4e5-d78a425cd3fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Acquiring lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa73736-9849-419e-9920-537a1e33def5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:05 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb Apr 28 04:59:05 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:05 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb" returned: 0 in 0.534s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:05 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb Apr 28 04:59:05 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Creating offline snapshot 93c1ef47-a444-4263-9470-914aca557c5d of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2741d7d4-ca30-47c9-8d33-d2f5757c58ba]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:06 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:06 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:06 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e92293a1-7432-4441-b4e5-d78a425cd3fb" returned: 0 in 0.519s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "cinder-quobyte-e92293a1-7432-4441-b4e5-d78a425cd3fb" released by "delete_volume" :: held 1.094s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Created reservations ['3451212c-e0ab-4ede-8500-515866cd1706', '59ea505d-ea34-4f83-979d-1728af1297d0', 'e9053438-6417-43cb-8ddd-edee549cc4c9', 'c9cb2a34-43ed-4130-90fb-983c8c2005cc'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:06 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:06 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:06 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.530s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:06 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d 1G Apr 28 04:59:06 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:06 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.454s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:06 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Deleted volume successfully. Apr 28 04:59:06 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-aacc89e6-5a6b-4990-bbe3-8af403c21b5e tempest-VolumeDependencyTests-819519062 None] Lock "cinder-e92293a1-7432-4441-b4e5-d78a425cd3fb-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:07 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d 1G" returned: 0 in 0.648s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:07 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d Apr 28 04:59:07 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:07 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d" returned: 0 in 0.533s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:07 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d is being set with open permissions: ugo+rw Apr 28 04:59:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:07 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d Apr 28 04:59:07 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:08 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d" returned: 0 in 0.481s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:08 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-545ab9d0-413d-4972-a1f9-a36567d503f4 tempest-SnapshotsActionsTest-1453799112 None] Create snapshot completed successfully Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-93c1ef47-a444-4263-9470-914aca557c5d-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-93c1ef47-a444-4263-9470-914aca557c5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-93c1ef47-a444-4263-9470-914aca557c5d" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-93c1ef47-a444-4263-9470-914aca557c5d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Deleting offline snapshot 93c1ef47-a444-4263-9470-914aca557c5d of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] snapshot_file for this snap is: volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[354601c2-e7e8-49a1-98fc-c2447431b856]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:09 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d Apr 28 04:59:09 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Flow 'volume_create_manager' (61761f5a-215c-4b58-a2c4-279da939da8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8e2e1a-5d0e-4c0c-a674-1b4196febc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8e2e1a-5d0e-4c0c-a674-1b4196febc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa220f1b-8dd5-485f-a2a6-45cb387a6b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0031d3b7b20740969c7bb96a1b25b32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:10Z,use_quota=True,user_id='2928717b69074083ad71ca1c0034ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d471c7-7eec-4a86-a35e-05e5ac63c9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d471c7-7eec-4a86-a35e-05e5ac63c9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49523fb3-8101-4f71-9c3c-c839b9f348d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49523fb3-8101-4f71-9c3c-c839b9f348d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa220f1b-8dd5-485f-a2a6-45cb387a6b7b', 'volume_name': 'volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7878990-0e83-43d6-ba3e-67ba0609af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7878990-0e83-43d6-ba3e-67ba0609af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81df98c4-62c0-40b7-ac17-ced5d6526062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:09 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Volume fa220f1b-8dd5-485f-a2a6-45cb387a6b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b', 'volume_size': 1} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa220f1b-8dd5-485f-a2a6-45cb387a6b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0031d3b7b20740969c7bb96a1b25b32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:10Z,use_quota=True,user_id='2928717b69074083ad71ca1c0034ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Creating volume fa220f1b-8dd5-485f-a2a6-45cb387a6b7b {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:59:09 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:09 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b 1073741824 Apr 28 04:59:09 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:09 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d" returned: 0 in 0.540s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d57507-e102-4f9c-afec-0449e0b925e8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:10 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:10 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:10 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b 1073741824" returned: 0 in 0.642s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:10 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.548s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:10 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:10 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:10 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d Apr 28 04:59:10 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:10 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81df98c4-62c0-40b7-ac17-ced5d6526062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fcca4e-0ba8-4aba-ad6e-339d8b543d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:10 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Volume volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b (fa220f1b-8dd5-485f-a2a6-45cb387a6b7b): created successfully Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fcca4e-0ba8-4aba-ad6e-339d8b543d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:10 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Flow 'volume_create_manager' (61761f5a-215c-4b58-a2c4-279da939da8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-178b06ff-b190-48e5-a073-b450fb9d82ff tempest-CinderUnicodeTest-901117374 None] Created volume successfully. Apr 28 04:59:11 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d" returned: 0 in 0.606s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:11 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d Apr 28 04:59:11 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:11 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.93c1ef47-a444-4263-9470-914aca557c5d" returned: 0 in 0.439s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-93c1ef47-a444-4263-9470-914aca557c5d" released by "_delete_snapshot" :: held 2.224s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_snapshot" :: held 2.245s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Created reservations ['3827deac-74ad-4c6f-9817-66609cd393b8', '2af96570-0f19-4c9c-b017-6bd10c5bc0dd', 'af9106ee-7519-44ad-9873-810404bbe345', '829322ff-eca8-4fcd-850e-eff4c3d4261e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:11 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Delete snapshot completed successfully. Apr 28 04:59:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-db6e626b-c69b-4180-81b1-d2dcefc81201 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-93c1ef47-a444-4263-9470-914aca557c5d-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Flow 'volume_create_manager' (6bcdf1ca-c3b8-4ec3-aeb4-fc4efd593fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9d879c-6c2c-49a3-899f-b364bd27cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9d879c-6c2c-49a3-899f-b364bd27cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1339684481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a6094-1d29-4b5c-bc88-1f436f3b3032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0031d3b7b20740969c7bb96a1b25b32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:12Z,use_quota=True,user_id='2928717b69074083ad71ca1c0034ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d1fa5b-c017-4aed-8835-60c2109c4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d1fa5b-c017-4aed-8835-60c2109c4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c749f-5e9c-4cec-aaed-17a44d1d2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c749f-5e9c-4cec-aaed-17a44d1d2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320a6094-1d29-4b5c-bc88-1f436f3b3032', 'volume_name': 'volume-320a6094-1d29-4b5c-bc88-1f436f3b3032', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ef109-b6aa-4a35-817d-8ec277aae69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ef109-b6aa-4a35-817d-8ec277aae69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7f8a5-1991-4a42-bb9a-ef4e3713c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:12 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Volume 320a6094-1d29-4b5c-bc88-1f436f3b3032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320a6094-1d29-4b5c-bc88-1f436f3b3032', 'volume_size': 1} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1339684481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a6094-1d29-4b5c-bc88-1f436f3b3032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0031d3b7b20740969c7bb96a1b25b32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:12Z,use_quota=True,user_id='2928717b69074083ad71ca1c0034ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Creating volume 320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:59:12 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:12 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 1073741824 Apr 28 04:59:12 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:12 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 1073741824" returned: 0 in 0.694s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=106,cinder:INSERT=24,cinder:UPDATE=117,cinder:DELETE=7 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:59:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:12 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 Apr 28 04:59:12 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:13 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7f8a5-1991-4a42-bb9a-ef4e3713c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320a6094-1d29-4b5c-bc88-1f436f3b3032', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d693d402-94f6-4dd2-a4d1-fb766cd3567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Creating offline snapshot 38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:13 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Volume volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 (320a6094-1d29-4b5c-bc88-1f436f3b3032): created successfully Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d693d402-94f6-4dd2-a4d1-fb766cd3567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Flow 'volume_create_manager' (6bcdf1ca-c3b8-4ec3-aeb4-fc4efd593fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c300c-e45a-440c-a5ef-3d504b88466b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d9db9460-fda7-41eb-a974-9640992a9dd3 tempest-CinderUnicodeTest-901117374 None] Created volume successfully. Apr 28 04:59:13 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:13 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:14 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.535s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:14 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 1G Apr 28 04:59:14 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=101,cinder:UPDATE=111,cinder:INSERT=32,cinder:DELETE=7 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:14 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 1G" returned: 0 in 0.665s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:14 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 Apr 28 04:59:14 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:15 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" returned: 0 in 0.488s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:15 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 is being set with open permissions: ugo+rw Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:15 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 Apr 28 04:59:15 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:15 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" returned: 0 in 0.424s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.132s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Creating offline snapshot fa479be3-338a-4e64-ba34-ed39aa146c38 of volume 320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8674bb14-6bc5-4de0-a451-dd2896373d46]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-fe763a9c-4c08-4ada-be46-5903af4951e7 tempest-SnapshotsActionsTest-1453799112 None] Create snapshot completed successfully Apr 28 04:59:15 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 Apr 28 04:59:15 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Deleting offline snapshot 38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] snapshot_file for this snap is: volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[675224ce-442e-4950-87b4-2cca6d1f5fa8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:16 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 Apr 28 04:59:16 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:16 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032" returned: 0 in 0.542s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:16 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 1G Apr 28 04:59:16 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:16 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" returned: 0 in 0.557s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d1a6d8-a070-451d-8914-4cf00d906949]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:16 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:16 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:16 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 1G" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:16 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 Apr 28 04:59:16 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:17 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.537s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:17 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 Apr 28 04:59:17 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:17 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38" returned: 0 in 0.501s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:17 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 is being set with open permissions: ugo+rw Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:17 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 Apr 28 04:59:17 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:17 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" returned: 0 in 0.598s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:17 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:17 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36 Apr 28 04:59:17 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38" returned: 0 in 0.489s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:17 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info Apr 28 04:59:17 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:18 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36" released by "_delete_snapshot" :: held 2.213s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_snapshot" :: held 2.237s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Created reservations ['29d39e6f-98e0-4916-a3b1-ab2b4d4a3f98', '24ea5fdf-507b-4010-95e4-74f3c36c16a1', '71ecfc83-baa2-4435-a649-cc65d5d5ece9', '85e038f8-b195-46c7-b8b3-4bdc078b6bd3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:18 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:18 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info is being set with open permissions: ugo+rw Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:18 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info Apr 28 04:59:18 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Delete snapshot completed successfully. Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7fa0858c-91b5-46f6-8d7f-ab355a73510a tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-38f56fb7-11e0-44be-9a0a-9b2e7fcc3b36-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:18 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.info" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.140s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4f9e3da4-4c61-4e1c-bed0-c38b243142c1 tempest-CinderUnicodeTest-901117374 None] Create snapshot completed successfully Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Creating offline snapshot 72b56892-a436-4328-89ea-7ab82b780439 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[118add42-5a1b-4d28-b0f0-c19adbd20593]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:19 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:19 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-fa479be3-338a-4e64-ba34-ed39aa146c38-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-fa479be3-338a-4e64-ba34-ed39aa146c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-quobyte-fa479be3-338a-4e64-ba34-ed39aa146c38" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-fa479be3-338a-4e64-ba34-ed39aa146c38" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Deleting offline snapshot fa479be3-338a-4e64-ba34-ed39aa146c38 of volume 320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] snapshot_file for this snap is: volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8e1eb-133e-44fa-ad9b-ccc2b19aa7ae]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:19 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 Apr 28 04:59:19 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:20 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.538s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:20 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 1G Apr 28 04:59:20 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:20 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38" returned: 0 in 0.516s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320a6094-1d29-4b5c-bc88-1f436f3b3032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c821a-9be5-4355-8124-7fd9e0a31042]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:20 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 Apr 28 04:59:20 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:20 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 1G" returned: 0 in 0.634s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:20 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 Apr 28 04:59:20 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:20 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032" returned: 0 in 0.562s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:20 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 Apr 28 04:59:20 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:21 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:21 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 is being set with open permissions: ugo+rw Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:21 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 Apr 28 04:59:21 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:21 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38" returned: 0 in 0.565s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:21 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38 Apr 28 04:59:21 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:21 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439" returned: 0 in 0.483s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ba4a6eaf-38ec-4151-be83-f40cb7739062 tempest-SnapshotsActionsTest-1453799112 None] Create snapshot completed successfully Apr 28 04:59:21 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032.fa479be3-338a-4e64-ba34-ed39aa146c38" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-fa479be3-338a-4e64-ba34-ed39aa146c38" released by "_delete_snapshot" :: held 2.180s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" released by "delete_snapshot" :: held 2.208s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Created reservations ['ffb1853a-9234-4c79-9104-013907df0671', '4512569d-7fc7-40b2-a4e6-40d031de79a1', '7306dd41-cdb9-490e-b5c7-7dff3ac29410', '2a7a5a1e-8c6d-411a-b052-082f7d7d845d'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Delete snapshot completed successfully. Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-76f01fb1-34ae-43ac-b18c-425ec7624357 tempest-CinderUnicodeTest-901117374 None] Lock "cinder-fa479be3-338a-4e64-ba34-ed39aa146c38-delete_snapshot" released by "delete_snapshot" :: held 2.337s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-72b56892-a436-4328-89ea-7ab82b780439-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-72b56892-a436-4328-89ea-7ab82b780439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-72b56892-a436-4328-89ea-7ab82b780439" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-72b56892-a436-4328-89ea-7ab82b780439" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Deleting offline snapshot 72b56892-a436-4328-89ea-7ab82b780439 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] snapshot_file for this snap is: volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35083d-e7e1-4478-82c4-38515556e383]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:22 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 Apr 28 04:59:22 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-320a6094-1d29-4b5c-bc88-1f436f3b3032-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "cinder-320a6094-1d29-4b5c-bc88-1f436f3b3032-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[848e7d7b-cf3c-4897-9a7d-0d5dd60f4f79]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:23 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 Apr 28 04:59:23 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:23 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3963a-cadd-46a3-949f-ac3fa1bfd62d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:23 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:23 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:23 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032" returned: 0 in 0.566s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:23 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032 Apr 28 04:59:23 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:23 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:23 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 Apr 28 04:59:23 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:24 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-320a6094-1d29-4b5c-bc88-1f436f3b3032" returned: 0 in 0.483s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-320a6094-1d29-4b5c-bc88-1f436f3b3032" released by "delete_volume" :: held 1.108s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Created reservations ['ef85372e-2ce5-4ed6-be81-5377d1ab1442', '1bd14d51-c5bf-4b83-87d4-4455549d94a5', 'd6d7c008-34bc-4000-a38e-48a384573ef9', '00aded67-a977-40a2-8a1c-77aa3bb37d30'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:24 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:24 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:24 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439" returned: 0 in 0.616s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:24 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439 Apr 28 04:59:24 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:24 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.505s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Deleted volume successfully. Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-105b06ef-23e3-4b80-85dc-151ed22ed6ee tempest-CinderUnicodeTest-901117374 None] Lock "cinder-320a6094-1d29-4b5c-bc88-1f436f3b3032-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:24 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.72b56892-a436-4328-89ea-7ab82b780439" returned: 0 in 0.456s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-72b56892-a436-4328-89ea-7ab82b780439" released by "_delete_snapshot" :: held 2.276s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:24 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_snapshot" :: held 2.299s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Created reservations ['2fbcc941-15a4-490c-9b97-bc72ec357a59', '991d1af0-9a62-44da-a947-e6d9af3c2605', '674fc602-1407-4b11-af66-4c2b397f153a', '91c34d89-3c9f-4d7b-8211-d530b37f5ae2'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Delete snapshot completed successfully. Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-526f62cc-6deb-4172-8993-f3a5bc013c63 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-72b56892-a436-4328-89ea-7ab82b780439-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "cinder-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Acquiring lock "cinder-quobyte-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[21778b1f-78a9-42b5-9853-ad356828daee]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:25 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b Apr 28 04:59:25 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:25 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:25 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b Apr 28 04:59:25 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Creating offline snapshot 43cbdc3c-3615-4420-8654-e96acc19c6cc of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08733f-9114-4488-929a-f0e14a2db758]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:26 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:26 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:26 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "cinder-quobyte-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b" released by "delete_volume" :: held 1.050s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Created reservations ['8f865a3c-87a4-47bb-8432-858d50413cf2', 'f8d65e40-c342-415a-9950-b72368998fa0', '4ff38994-f750-4b14-8ea5-5a4eecb8a6e7', 'fc84f46a-2e08-4bb5-bd00-c4b7d0a7ee90'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:26 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:26 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:26 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:26 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc 1G Apr 28 04:59:26 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:26 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Deleted volume successfully. Apr 28 04:59:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5db82b4b-c954-4778-8cc1-74898033fe1b tempest-CinderUnicodeTest-901117374 None] Lock "cinder-fa220f1b-8dd5-485f-a2a6-45cb387a6b7b-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:27 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc 1G" returned: 0 in 0.640s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:27 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc Apr 28 04:59:27 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:27 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc" returned: 0 in 0.524s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:27 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc is being set with open permissions: ugo+rw Apr 28 04:59:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:27 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc Apr 28 04:59:27 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:28 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc" returned: 0 in 0.476s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b48c2a2b-b8eb-48ed-80fd-6bca7fdcb4bc tempest-SnapshotsActionsTest-1453799112 None] Create snapshot completed successfully Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-43cbdc3c-3615-4420-8654-e96acc19c6cc-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-43cbdc3c-3615-4420-8654-e96acc19c6cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Acquiring lock "cinder-quobyte-43cbdc3c-3615-4420-8654-e96acc19c6cc" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-43cbdc3c-3615-4420-8654-e96acc19c6cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Deleting offline snapshot 43cbdc3c-3615-4420-8654-e96acc19c6cc of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] snapshot_file for this snap is: volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed585d-509d-47f3-8f6a-3676a95e0c0a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:29 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc Apr 28 04:59:29 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:29 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc" returned: 0 in 0.499s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff72fd-89a9-49e5-9636-de2394bf30c9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:29 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:29 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:30 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:30 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc Apr 28 04:59:30 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:30 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc" returned: 0 in 0.574s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:30 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc Apr 28 04:59:30 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:31 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.43cbdc3c-3615-4420-8654-e96acc19c6cc" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-43cbdc3c-3615-4420-8654-e96acc19c6cc" released by "_delete_snapshot" :: held 2.101s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_snapshot" :: held 2.123s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:31 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Created reservations ['7a19a644-cfa8-4bf0-b942-ff4ceaaad7bb', '3313da84-50c9-40c5-9c79-fdef91189ad0', '67d420bd-c2f4-443d-a14c-5047f5a3e609', '62a4a16b-aa38-4d1c-be33-5155670b027f'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Delete snapshot completed successfully. Apr 28 04:59:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-430ebf75-11da-4f18-910c-7d2ba0fdd640 tempest-SnapshotsActionsTest-510112025 None] Lock "cinder-43cbdc3c-3615-4420-8654-e96acc19c6cc-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "cinder-4834e292-1496-4061-96c2-a3b644e8a4e3-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-4834e292-1496-4061-96c2-a3b644e8a4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "cinder-quobyte-4834e292-1496-4061-96c2-a3b644e8a4e3" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4834e292-1496-4061-96c2-a3b644e8a4e3" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Deleting offline snapshot 4834e292-1496-4061-96c2-a3b644e8a4e3 of volume 4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] snapshot_file for this snap is: volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abf636-141d-4bab-a94d-c6805a40d542]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:32 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:32 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:33 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.513s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e7afd-1d7c-4152-b11b-8f3f2b4120e9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:33 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d Apr 28 04:59:33 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:33 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d" returned: 0 in 0.495s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:33 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:33 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:34 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.517s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:34 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3 Apr 28 04:59:34 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:34 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d.4834e292-1496-4061-96c2-a3b644e8a4e3" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4834e292-1496-4061-96c2-a3b644e8a4e3" released by "_delete_snapshot" :: held 2.060s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_snapshot" :: held 2.119s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:34 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Created reservations ['8f51a9e6-0fd4-4e27-bad2-8eb014caf796', '86f3f4fd-087d-42b3-abb5-3a6cf9d9e159', '11ce709a-49fa-4745-9ce0-a96da1a79c14', 'efd737c0-37a8-4b19-97aa-970b728eaabc'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:35 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Delete snapshot completed successfully. Apr 28 04:59:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-87d18984-07a0-445c-a7fc-8346ebbab44d tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-4834e292-1496-4061-96c2-a3b644e8a4e3-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "cinder-4bbb8361-90d6-441b-a9bf-67afd2d1972d-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-4bbb8361-90d6-441b-a9bf-67afd2d1972d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" acquired by "delete_volume" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1ed479-d66d-44cd-a013-5c065beb7932]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:36 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d Apr 28 04:59:36 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:36 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d" returned: 0 in 0.499s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:36 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d Apr 28 04:59:36 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:37 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4bbb8361-90d6-441b-a9bf-67afd2d1972d" returned: 0 in 0.419s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-quobyte-4bbb8361-90d6-441b-a9bf-67afd2d1972d" released by "delete_volume" :: held 0.978s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Created reservations ['8ae69254-c480-4600-815e-5be69ecfe6a1', 'd4267eb1-5cab-4810-b4f0-8cb4c78863db', 'b326954f-aecd-44e2-9ebe-e59c83334c75', '97704e0c-35d3-409e-8f1a-5fea2a984aea'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:37 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:37 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:37 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.435s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Deleted volume successfully. Apr 28 04:59:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c5ede69a-431f-4cdd-ba6e-aa8d5210a388 tempest-SnapshotsActionsTest-1453799112 None] Lock "cinder-4bbb8361-90d6-441b-a9bf-67afd2d1972d-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Flow 'volume_create_manager' (40985a11-09ba-400d-bff8-c301379f12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3702fc-87da-4c68-9ffc-657f52647921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3702fc-87da-4c68-9ffc-657f52647921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1517981004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befc2564-a6f9-4e61-8cc5-755ee74e7be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfe549b21df47e5a94a781c2eb5f2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:46Z,use_quota=True,user_id='de670a62ec8d4d2aae04e5885602af45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8504b677-43c2-4fdc-94cd-201883bde390),volume_type_id=8504b677-43c2-4fdc-94cd-201883bde390)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ba92a2-1a95-4d37-bb70-11e459f0183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ba92a2-1a95-4d37-bb70-11e459f0183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a494f33-f638-45d1-8532-83becb91fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a494f33-f638-45d1-8532-83becb91fe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'befc2564-a6f9-4e61-8cc5-755ee74e7be4', 'volume_name': 'volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42d36f-dedb-463b-ae95-79f63f779257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42d36f-dedb-463b-ae95-79f63f779257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4026b9ad-1f72-49a3-b280-1f61f3748a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Volume befc2564-a6f9-4e61-8cc5-755ee74e7be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4', 'volume_size': 1} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T02:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1517981004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befc2564-a6f9-4e61-8cc5-755ee74e7be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfe549b21df47e5a94a781c2eb5f2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T02:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T02:59:46Z,use_quota=True,user_id='de670a62ec8d4d2aae04e5885602af45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8504b677-43c2-4fdc-94cd-201883bde390),volume_type_id=8504b677-43c2-4fdc-94cd-201883bde390)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Creating volume befc2564-a6f9-4e61-8cc5-755ee74e7be4 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 04:59:46 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 04:59:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:46 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 1073741824 Apr 28 04:59:46 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:47 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 1073741824" returned: 0 in 0.604s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:47 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 Apr 28 04:59:47 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:47 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4026b9ad-1f72-49a3-b280-1f61f3748a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530f23aa-581c-4fd5-a187-424c5f9c9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 04:59:47 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Volume volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 (befc2564-a6f9-4e61-8cc5-755ee74e7be4): created successfully Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530f23aa-581c-4fd5-a187-424c5f9c9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 04:59:47 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Flow 'volume_create_manager' (40985a11-09ba-400d-bff8-c301379f12c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 04:59:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-643c7725-ed6d-4e59-97f0-4c8eccdec04c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Created volume successfully. Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:48 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:48 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:49 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.437s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:49 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:49 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ec6d1712-f5f5-4476-bdcb-c312aefcbb0c tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Retype volume completed successfully. Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "cinder-befc2564-a6f9-4e61-8cc5-755ee74e7be4-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "cinder-befc2564-a6f9-4e61-8cc5-755ee74e7be4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "cinder-quobyte-befc2564-a6f9-4e61-8cc5-755ee74e7be4" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "cinder-quobyte-befc2564-a6f9-4e61-8cc5-755ee74e7be4" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa5c51-7abf-4263-8776-7ddd9372cc62]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:50 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 Apr 28 04:59:50 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:50 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4" returned: 0 in 0.515s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:50 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4 Apr 28 04:59:50 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:51 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-befc2564-a6f9-4e61-8cc5-755ee74e7be4" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "cinder-quobyte-befc2564-a6f9-4e61-8cc5-755ee74e7be4" released by "delete_volume" :: held 0.987s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:51 devstack cinder-volume[82097]: WARNING cinder.quota [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:59:51 devstack cinder-volume[82097]: WARNING cinder.quota [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Created reservations ['0eb8a7b4-cbf9-41df-8140-8f673a8e7e63', '4d7735f9-1b96-48f1-8376-792169436c01', '34450f2d-d701-4363-8f09-2aaaf9099cfe', 'c63b8e5a-f903-49b0-b1de-d7c6f9bad4e9'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:51 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:51 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:51 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 04:59:51 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Deleted volume successfully. Apr 28 04:59:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7dcf5c00-a58a-489c-99aa-a322db2376b9 tempest-VolumeRetypeWithoutMigrationTest-1272050530 None] Lock "cinder-befc2564-a6f9-4e61-8cc5-755ee74e7be4-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 04:59:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 04:59:56 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 04:59:56 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 04:59:57 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 28 04:59:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.494s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 04:59:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (55266d75-2384-41a5-8fc9-40fa3c53bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be0f18-9170-4498-ae46-2ea89c8cae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be0f18-9170-4498-ae46-2ea89c8cae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565478159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bc8151-7bdc-4526-b3fd-f77a0622b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b13a5ac415448b28f0ca02c6fe88afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:02Z,use_quota=True,user_id='c6366cc4ae1f4855b334e9fd67c057c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0a4bb-f0e7-45e0-8696-0e99c3aa5442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0a4bb-f0e7-45e0-8696-0e99c3aa5442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133bb02-cf36-4fbe-8d17-7916c5ccb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133bb02-cf36-4fbe-8d17-7916c5ccb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bc8151-7bdc-4526-b3fd-f77a0622b51a', 'volume_name': 'volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57c5875-55bb-42c0-885c-b974860f103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57c5875-55bb-42c0-885c-b974860f103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73301a4-db34-4b48-ba37-c5008548efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:02 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a', 'volume_size': 1} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565478159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bc8151-7bdc-4526-b3fd-f77a0622b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b13a5ac415448b28f0ca02c6fe88afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:02Z,use_quota=True,user_id='c6366cc4ae1f4855b334e9fd67c057c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Creating volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:00:02 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:00:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:02 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a 1073741824 Apr 28 05:00:02 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:02 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a 1073741824" returned: 0 in 0.630s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:03 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:03 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:03 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.436s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73301a4-db34-4b48-ba37-c5008548efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf91d8de-ecab-48d3-a2b4-cb10f34c0a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:03 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Volume volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a (e9bc8151-7bdc-4526-b3fd-f77a0622b51a): created successfully Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf91d8de-ecab-48d3-a2b4-cb10f34c0a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (55266d75-2384-41a5-8fc9-40fa3c53bd78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:03 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-494a3e23-01f7-46ec-9d1f-bc3c2f1e0d6a tempest-VolumesDeleteCascade-1384079901 None] Created volume successfully. Apr 28 05:00:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Creating offline snapshot 810acdf9-15e4-43b7-b3a8-c4dd2139ca6f of volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:00:04 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c96b0e-1b0e-43fb-8bfe-7b97bc8e8fe4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:04 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:04 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:05 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:05 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f 1G Apr 28 05:00:05 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:05 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f 1G" returned: 0 in 0.627s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:05 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:05 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:06 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.491s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:06 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f is being set with open permissions: ugo+rw Apr 28 05:00:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:06 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:06 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:06 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.447s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:06 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info Apr 28 05:00:06 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:07 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info" returned: 0 in 0.437s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:07 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info is being set with open permissions: ugo+rw Apr 28 05:00:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:07 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info Apr 28 05:00:07 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:07 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.info" returned: 0 in 0.418s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:07 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bbf8e0bf-fc5d-4f0c-887a-82fec0e9cfdf tempest-VolumesDeleteCascade-1384079901 None] Create snapshot completed successfully Apr 28 05:00:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Creating offline snapshot e4554f87-c8a5-4bda-83cf-a7cc26dd06eb of volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:00:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7faee78-5e67-4567-a406-69f7da04bb54]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:09 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:09 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:09 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.510s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:09 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb 1G Apr 28 05:00:09 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:10 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb 1G" returned: 0 in 0.639s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:10 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:10 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:10 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.472s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:10 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb is being set with open permissions: ugo+rw Apr 28 05:00:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:10 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:10 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:11 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.439s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:11 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a2645dc8-8957-48ff-9c72-39404252f60d tempest-VolumesDeleteCascade-1384079901 None] Create snapshot completed successfully Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-e9bc8151-7bdc-4526-b3fd-f77a0622b51a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-e9bc8151-7bdc-4526-b3fd-f77a0622b51a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Performing cascade delete. {{(pid=82097) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Deleting offline snapshot 810acdf9-15e4-43b7-b3a8-c4dd2139ca6f of volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] snapshot_file for this snap is: volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604a6ea-77eb-41b0-bd94-6669e155a18a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:12 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:12 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:12 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.503s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cae0a0-c40c-4a43-ac16-31e91af5f1cb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:12 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:12 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:13 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff103f9-85cc-4ce1-b055-49d2ffc752c7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:13 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:13 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:13 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.499s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e5b37-775a-4810-ba27-ef04ffd65aca]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:13 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:13 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:14 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ace7a-998d-41be-8c0b-baa5733df820]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:14 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:14 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:14 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:14 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:14 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:15 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.521s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:15 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f Apr 28 05:00:15 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:15 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" returned: 0 in 0.423s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb -F qcow2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:15 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb -F qcow2 Apr 28 05:00:15 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:16 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb -F qcow2" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f" released by "_delete_snapshot" :: held 4.122s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" released by "delete_snapshot" :: held 4.142s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=76,cinder:UPDATE=82,cinder:DELETE=6,cinder:INSERT=22 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=75,cinder:DELETE=7,cinder:UPDATE=74,cinder:INSERT=18 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['af0ce968-cb38-4c1b-9da6-67a4a6ecad84', 'f4b715f1-5688-4805-858a-091bddfe8638', '4cab1467-f052-4493-9f95-d6ef810faaf9', 'ccf50803-6b6e-4cb2-87f0-ac532d1a977e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Delete snapshot completed successfully. Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-810acdf9-15e4-43b7-b3a8-c4dd2139ca6f-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Deleting offline snapshot e4554f87-c8a5-4bda-83cf-a7cc26dd06eb of volume e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] snapshot_file for this snap is: volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473bee7-ad6b-4257-9d08-b0aa5ef5f01b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:16 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:16 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:17 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.516s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb7138b-8437-4665-a874-5d39a5a7680d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:17 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:17 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:17 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:17 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:17 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:18 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.535s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:18 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb Apr 28 05:00:18 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:18 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a.e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" returned: 0 in 0.439s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb" released by "_delete_snapshot" :: held 2.093s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" released by "delete_snapshot" :: held 2.122s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['2ce43743-2f28-4782-a2c0-e907670479e9', '32ef162c-f10a-4a5c-bed5-c568364676c9', 'b83cd13e-895c-400b-ab7a-de0ded1b09f6', '9e34203b-098f-4ef1-9136-da404efc6f29'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Delete snapshot completed successfully. Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-e4554f87-c8a5-4bda-83cf-a7cc26dd06eb-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Snapshots deleted, issuing volume delete {{(pid=82097) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee13f6f-e1c4-4c0a-ac9e-72ed01526dd3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:18 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:18 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:19 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.524s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:19 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a Apr 28 05:00:19 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:19 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" returned: 0 in 0.431s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-e9bc8151-7bdc-4526-b3fd-f77a0622b51a" released by "delete_volume" :: held 1.011s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['e1a8e4a4-3a7c-4b5e-ba2a-dac6983b0ad1', 'ac43a06d-5479-4396-bb86-b9a6a4bf44ff', '49a0710f-768a-4f25-906d-fadf6156aa54', '5d37f22a-f6b5-40c5-a6eb-3460f622f928'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:19 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:00:19 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:20 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:20 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:00:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Deleted volume successfully. Apr 28 05:00:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4be17fd9-17ed-4166-baaf-2aecd02cdc5e tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-e9bc8151-7bdc-4526-b3fd-f77a0622b51a-delete_volume" released by "delete_volume" :: held 8.237s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (a1db208b-9cd3-4f8d-84e7-6cc8df4785a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded98c57-8c19-4d92-a8c3-0bbc0f40b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded98c57-8c19-4d92-a8c3-0bbc0f40b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-273485818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf529a0-4897-4bd4-9fdc-376c2576b3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b13a5ac415448b28f0ca02c6fe88afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:21Z,use_quota=True,user_id='c6366cc4ae1f4855b334e9fd67c057c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec131c-606d-4146-b517-6fa24303f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec131c-606d-4146-b517-6fa24303f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d1ee97-582c-4df1-82b9-aad6059f4858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d1ee97-582c-4df1-82b9-aad6059f4858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf529a0-4897-4bd4-9fdc-376c2576b3d4', 'volume_name': 'volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d1db5f-574d-4e72-898f-738e42cd2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d1db5f-574d-4e72-898f-738e42cd2648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d323baef-2ced-412b-8af0-71f0dd3bb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Volume faf529a0-4897-4bd4-9fdc-376c2576b3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4', 'volume_size': 1} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-273485818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf529a0-4897-4bd4-9fdc-376c2576b3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b13a5ac415448b28f0ca02c6fe88afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:21Z,use_quota=True,user_id='c6366cc4ae1f4855b334e9fd67c057c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Creating volume faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:00:21 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:21 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 1073741824 Apr 28 05:00:21 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:21 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 1073741824" returned: 0 in 0.593s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:21 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:21 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:22 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.439s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d323baef-2ced-412b-8af0-71f0dd3bb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d182a1d4-5963-4f9a-82e4-0b8c191aaf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:22 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Volume volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 (faf529a0-4897-4bd4-9fdc-376c2576b3d4): created successfully Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d182a1d4-5963-4f9a-82e4-0b8c191aaf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:22 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (a1db208b-9cd3-4f8d-84e7-6cc8df4785a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:22 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1a29c922-4073-4a07-b83b-d08d5d078541 tempest-VolumesDeleteCascade-1384079901 None] Created volume successfully. Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Creating offline snapshot 83046845-a532-449b-ab0b-6c5bcd3a6f47 of volume faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc100c72-2413-4da8-aa65-7bb02b9a50ce]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:23 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:23 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:23 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.530s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:23 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 1G Apr 28 05:00:23 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:24 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 1G" returned: 0 in 0.587s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:24 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:24 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:24 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.455s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:24 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 is being set with open permissions: ugo+rw Apr 28 05:00:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:24 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:24 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:25 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:25 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info Apr 28 05:00:25 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:25 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info" returned: 0 in 0.431s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:25 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info is being set with open permissions: ugo+rw Apr 28 05:00:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:25 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info Apr 28 05:00:25 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:26 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.info" returned: 0 in 0.439s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7ad53bd2-4d7a-4363-982b-1b585c41ea93 tempest-VolumesDeleteCascade-1384079901 None] Create snapshot completed successfully Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (eab0c16a-2be7-49e4-ae37-110606af3e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9ce20d-57bd-4736-b7d4-d590414bb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9ce20d-57bd-4736-b7d4-d590414bb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-653423231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b13a5ac415448b28f0ca02c6fe88afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83046845-a532-449b-ab0b-6c5bcd3a6f47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:27Z,use_quota=True,user_id='c6366cc4ae1f4855b334e9fd67c057c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ca693c-47b4-498e-a8f8-039f4017bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ca693c-47b4-498e-a8f8-039f4017bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397181c-d2a3-44b1-88b6-09cfe900c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397181c-d2a3-44b1-88b6-09cfe900c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e', 'volume_name': 'volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e', 'volume_size': 1, 'snapshot_id': '83046845-a532-449b-ab0b-6c5bcd3a6f47'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6584266-93b3-45a3-8c9b-26fba64d1eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6584266-93b3-45a3-8c9b-26fba64d1eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5473717-72cf-4b46-b1dd-1ae6037afc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:26 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Volume 13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e', 'volume_size': 1, 'snapshot_id': '83046845-a532-449b-ab0b-6c5bcd3a6f47'} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Creating volume 13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e from snapshot 83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] snapshot: 83046845-a532-449b-ab0b-6c5bcd3a6f47, volume: 13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[32182264-78f7-48e8-b738-38db082a3016]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:27 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:27 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:27 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.519s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe75355-1157-483c-9a8e-a08217f3a3c6]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:27 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:27 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:28 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.502s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:28 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:00:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:28 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e Apr 28 05:00:28 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:32 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" returned: 0 in 4.475s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:32 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d413b3-39bc-4a4d-8d9d-be23a4c78f4f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:32 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:32 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:33 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.650s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:00:33 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Converted 1024.00 MB image at 228.74 MB/s Apr 28 05:00:33 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e is being set with open permissions: ugo+rw Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:33 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e Apr 28 05:00:33 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:33 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" returned: 0 in 0.428s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" released by "_copy_volume_from_snapshot" :: held 6.670s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" released by "_create_volume_from_snapshot" :: held 6.704s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.727s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5473717-72cf-4b46-b1dd-1ae6037afc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e', 'volume_size': 1, 'snapshot_id': '83046845-a532-449b-ab0b-6c5bcd3a6f47'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f945ca1-d6df-48bb-a862-5d676a325078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Volume volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e (13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e): created successfully Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f945ca1-d6df-48bb-a862-5d676a325078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Flow 'volume_create_manager' (eab0c16a-2be7-49e4-ae37-110606af3e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-245101ed-2315-4187-83bf-fe6b9e948dc7 tempest-VolumesDeleteCascade-1384079901 None] Created volume successfully. Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-faf529a0-4897-4bd4-9fdc-376c2576b3d4-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-faf529a0-4897-4bd4-9fdc-376c2576b3d4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Performing cascade delete. {{(pid=82097) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-83046845-a532-449b-ab0b-6c5bcd3a6f47-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-83046845-a532-449b-ab0b-6c5bcd3a6f47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Deleting offline snapshot 83046845-a532-449b-ab0b-6c5bcd3a6f47 of volume faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] snapshot_file for this snap is: volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8e409-c558-4c2c-986b-2dfba376628f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:34 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:34 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:35 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.515s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[795252c5-4086-44a4-90a7-350985f84542]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:35 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:35 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:35 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:35 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:35 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:36 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.527s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:36 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47 Apr 28 05:00:36 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:36 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4.83046845-a532-449b-ab0b-6c5bcd3a6f47" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-83046845-a532-449b-ab0b-6c5bcd3a6f47" released by "_delete_snapshot" :: held 2.088s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" released by "delete_snapshot" :: held 2.110s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['ca0358cd-a075-4705-a9b7-78ba0f12a5a4', '208827bf-5c13-4511-a90b-00d76f6b486a', '5dc86786-b24d-41a2-b10e-9a3cb1f675d8', '298b921b-6a4f-43f7-b2c8-2f8f80149676'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Delete snapshot completed successfully. Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-83046845-a532-449b-ab0b-6c5bcd3a6f47-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Snapshots deleted, issuing volume delete {{(pid=82097) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" acquired by "delete_volume" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[467aef54-7552-4ca2-af5e-ae66d47d3e9b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:36 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:36 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:37 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.508s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:37 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4 Apr 28 05:00:37 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:37 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-faf529a0-4897-4bd4-9fdc-376c2576b3d4" returned: 0 in 0.420s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-faf529a0-4897-4bd4-9fdc-376c2576b3d4" released by "delete_volume" :: held 0.984s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['83a1982c-c7d7-401f-909d-5b28251ca820', 'a60406e3-a0eb-4080-bf54-b91591fb89b0', 'a864cf46-a2fd-4487-9561-60eae156e5ef', '2a74711f-b9f6-4cbe-912b-929873293a5e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:37 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:00:37 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:38 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:00:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Deleted volume successfully. Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ef4f8aec-4e6a-4465-b26d-9b9754c42c5f tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-faf529a0-4897-4bd4-9fdc-376c2576b3d4-delete_volume" released by "delete_volume" :: held 3.910s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:00:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:00:39 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5354d1-0d88-44c0-90b1-29a554180027]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:00:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:39 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e Apr 28 05:00:39 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:39 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" returned: 0 in 0.512s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:39 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e Apr 28 05:00:39 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:39 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-quobyte-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e" released by "delete_volume" :: held 1.001s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Created reservations ['afa06b7a-5396-4ae9-9cd0-15c860bd1868', '8ad7a443-11fb-44d6-9fe0-3663a320dcf8', '65ce70b0-48d1-46cb-87ee-0309fac911c4', 'bd64cfc2-a56d-4479-9fe2-836aac6e077c'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:40 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:00:40 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:40 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.467s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:00:40 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Deleted volume successfully. Apr 28 05:00:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2f15de84-057b-4f70-b66b-a5965c87f035 tempest-VolumesDeleteCascade-1384079901 None] Lock "cinder-13edd5af-cd7c-415d-8ccf-7bebf0e2dc7e-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:00:50 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=45,cinder:SELECT=34,cinder:INSERT=15,cinder:DELETE=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:00:50 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=38,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Flow 'volume_create_manager' (707471d4-8b58-4580-8f48-f3db9e48665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b2ee8-817f-46c8-a01d-c45555967f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b2ee8-817f-46c8-a01d-c45555967f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1745753890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6fa776-1eec-4bda-9047-7a1a05560105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1056803429dc4f2187b657e0b2d1a2e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:51Z,use_quota=True,user_id='0eac1a097897479bb99cf52ed7b086dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c203813-4751-49b5-9760-eabbc2bf6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c203813-4751-49b5-9760-eabbc2bf6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7561c015-27f7-46b0-b1d2-dee0a9ae278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7561c015-27f7-46b0-b1d2-dee0a9ae278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6fa776-1eec-4bda-9047-7a1a05560105', 'volume_name': 'volume-ff6fa776-1eec-4bda-9047-7a1a05560105', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daa56c6-cef2-487e-9e61-e50c7814d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daa56c6-cef2-487e-9e61-e50c7814d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea86b71e-f2d8-4eec-a8f0-0c5bd3214c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:51 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Volume ff6fa776-1eec-4bda-9047-7a1a05560105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6fa776-1eec-4bda-9047-7a1a05560105', 'volume_size': 1} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1745753890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6fa776-1eec-4bda-9047-7a1a05560105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1056803429dc4f2187b657e0b2d1a2e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:00:51Z,use_quota=True,user_id='0eac1a097897479bb99cf52ed7b086dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Creating volume ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:00:51 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:00:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:51 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 1073741824 Apr 28 05:00:51 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:52 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 1073741824" returned: 0 in 0.597s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:52 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:00:52 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:52 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.460s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea86b71e-f2d8-4eec-a8f0-0c5bd3214c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6fa776-1eec-4bda-9047-7a1a05560105', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cd3360-32bf-46d9-ae6b-e7c37fc0183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:00:52 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Volume volume-ff6fa776-1eec-4bda-9047-7a1a05560105 (ff6fa776-1eec-4bda-9047-7a1a05560105): created successfully Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cd3360-32bf-46d9-ae6b-e7c37fc0183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:00:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Flow 'volume_create_manager' (707471d4-8b58-4580-8f48-f3db9e48665a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:00:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-dfe3cb96-8532-459d-a773-a6f2dc0b8dd9 tempest-VolumesActionsTest-39302367 None] Created volume successfully. Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:00:56 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:00:56 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:00:56 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:00:56 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:01:02 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:01:02 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eb66cb7f-4de1-4643-b1a0-4f197e0ab6d0 tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" by "attach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eb66cb7f-4de1-4643-b1a0-4f197e0ab6d0 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" acquired by "attach_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:01:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-eb66cb7f-4de1-4643-b1a0-4f197e0ab6d0 tempest-VolumesActionsTest-39302367 None] Attaching volume ff6fa776-1eec-4bda-9047-7a1a05560105 to instance e6f46ee6-a7dd-4d67-a103-8a33392d8ec5 at mountpoint /dev/vdb on host None. Apr 28 05:01:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-eb66cb7f-4de1-4643-b1a0-4f197e0ab6d0 tempest-VolumesActionsTest-39302367 None] Attach volume completed successfully. Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-eb66cb7f-4de1-4643-b1a0-4f197e0ab6d0 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" released by "attach_volume" :: held 0.090s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ce37c325-ba4e-42fb-95fe-8924b5c3bd60 tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" by "detach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ce37c325-ba4e-42fb-95fe-8924b5c3bd60 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:01:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ce37c325-ba4e-42fb-95fe-8924b5c3bd60 tempest-VolumesActionsTest-39302367 None] Detaching volume ff6fa776-1eec-4bda-9047-7a1a05560105 from instance e6f46ee6-a7dd-4d67-a103-8a33392d8ec5. Apr 28 05:01:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ce37c325-ba4e-42fb-95fe-8924b5c3bd60 tempest-VolumesActionsTest-39302367 None] Detach volume completed successfully. Apr 28 05:01:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ce37c325-ba4e-42fb-95fe-8924b5c3bd60 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:01:20 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:01:20 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:01:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32a69ad3-3b08-44be-b66d-7aed296289eb tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" by "attach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:01:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32a69ad3-3b08-44be-b66d-7aed296289eb tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" acquired by "attach_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:01:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-32a69ad3-3b08-44be-b66d-7aed296289eb tempest-VolumesActionsTest-39302367 None] Attaching volume ff6fa776-1eec-4bda-9047-7a1a05560105 to instance b4fb0c6b-f1bc-4310-af61-c72c99640297 at mountpoint /dev/vdb on host None. Apr 28 05:01:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-32a69ad3-3b08-44be-b66d-7aed296289eb tempest-VolumesActionsTest-39302367 None] Attach volume completed successfully. Apr 28 05:01:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-32a69ad3-3b08-44be-b66d-7aed296289eb tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105" released by "attach_volume" :: held 0.090s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:01:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a28019c-69c7-44b0-a7fe-77096c5a78c2 tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" by "detach_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:01:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a28019c-69c7-44b0-a7fe-77096c5a78c2 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:01:35 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a28019c-69c7-44b0-a7fe-77096c5a78c2 tempest-VolumesActionsTest-39302367 None] Detaching volume ff6fa776-1eec-4bda-9047-7a1a05560105 from instance b4fb0c6b-f1bc-4310-af61-c72c99640297. Apr 28 05:01:35 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-7a28019c-69c7-44b0-a7fe-77096c5a78c2 tempest-VolumesActionsTest-39302367 None] Detach volume completed successfully. Apr 28 05:01:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-7a28019c-69c7-44b0-a7fe-77096c5a78c2 tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11673d9-d810-4f07-8e78-dec786b84418]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:01:45 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:01:45 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:01:45 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7ee20-6109-4cff-94b0-30fa3b9e0ed0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:01:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:01:45 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:01:45 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:01:46 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 28 05:01:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.512s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:01:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.5a4b6e58-4b2d-4da1-991f-e57f45576186tpjd8omr.img {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:01:46 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.5a4b6e58-4b2d-4da1-991f-e57f45576186tpjd8omr.img Apr 28 05:01:46 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:01:50 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 28 05:01:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.5a4b6e58-4b2d-4da1-991f-e57f45576186tpjd8omr.img" returned: 0 in 4.343s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:01:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7575894c-9cb7-42b0-8f01-d8b3cfb7fc5c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:01:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:01:50 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:01:50 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:01:51 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 28 05:01:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:01:51 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.5a4b6e58-4b2d-4da1-991f-e57f45576186tpjd8omr.img {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:01:51 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Converted 1024.00 MB image at 235.72 MB/s Apr 28 05:01:51 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] 5a4b6e58-4b2d-4da1-991f-e57f45576186 was raw, no need to convert to raw {{(pid=82097) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:01:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:01:56 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:01:56 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:01:57 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 28 05:01:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:01:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.894s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Uploaded volume to glance image-id: 5a4b6e58-4b2d-4da1-991f-e57f45576186. {{(pid=82097) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 05:02:06 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a06e92ce-32f9-4393-bb22-e1b3ae6b36d6 tempest-VolumesActionsTest-39302367 None] Copy volume to image completed successfully. Apr 28 05:02:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:07 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd817bc-ff41-4b95-bef4-c357415861d1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:07 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:02:07 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:08 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.529s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d13614-6953-4088-8fa7-9242b5887460]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:08 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:02:08 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:08 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.522s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:08 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img Apr 28 05:02:08 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:13 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img" returned: 0 in 4.312s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b24e99-720b-48a3-bc61-37bd58637f08]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:13 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:02:13 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:13 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.630s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:02:13 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Converted 1024.00 MB image at 237.38 MB/s Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] a15f54c3-1f99-42f3-9a3e-04097d8cf80f was raw, converting to qcow2 {{(pid=82097) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f5c1f-d995-4e9e-a5ec-7dd03c17c828]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:13 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img Apr 28 05:02:13 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:14 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img" returned: 0 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:14 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img Apr 28 05:02:14 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:14 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img" returned: 1 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img' failed. Not Retrying. {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:02:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img /opt/stack/data/cinder/conversion/vol_upload_ub9oef95 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:14 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img /opt/stack/data/cinder/conversion/vol_upload_ub9oef95 Apr 28 05:02:14 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:15 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img /opt/stack/data/cinder/conversion/vol_upload_ub9oef95" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:15 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Image conversion details: src /opt/stack/data/cinder/conversion/ff6fa776-1eec-4bda-9047-7a1a05560105.temp_image.a15f54c3-1f99-42f3-9a3e-04097d8cf80f3uarzka4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ub9oef95 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:02:15 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 28 05:02:15 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacaaf0a-a44d-4f23-b173-1b45ca917de4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ub9oef95 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:15 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ub9oef95 Apr 28 05:02:15 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:15 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ub9oef95" returned: 0 in 0.468s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.095s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Uploaded volume to glance image-id: a15f54c3-1f99-42f3-9a3e-04097d8cf80f. {{(pid=82097) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 05:02:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-03aac248-b7a1-47e9-871e-0930db69ee84 tempest-VolumesActionsTest-39302367 None] Copy volume to image completed successfully. Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Acquiring lock "cinder-quobyte-ff6fa776-1eec-4bda-9047-7a1a05560105" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "cinder-quobyte-ff6fa776-1eec-4bda-9047-7a1a05560105" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88d74c-083b-47ee-ad4d-c40bf3ec4ee9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:17 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:02:17 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:18 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:18 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105 Apr 28 05:02:18 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:18 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-ff6fa776-1eec-4bda-9047-7a1a05560105" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "cinder-quobyte-ff6fa776-1eec-4bda-9047-7a1a05560105" released by "delete_volume" :: held 0.988s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Created reservations ['323b7c67-8957-4bf7-92e7-e60ad064b911', '9bf7e585-18e2-415e-af85-d4150f2bd305', '9a1b2b3c-1216-4798-b177-2465be342f5a', '69285961-2a14-4e7f-9d55-9b77d7f4bc5e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:18 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:18 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:19 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.421s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:19 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Deleted volume successfully. Apr 28 05:02:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-f1e71387-02f3-480e-8164-866a678652ad tempest-VolumesActionsTest-39302367 None] Lock "cinder-ff6fa776-1eec-4bda-9047-7a1a05560105-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Flow 'volume_create_manager' (fd9bba62-4759-43b9-9b95-0d515fe42670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bf63ca-ef19-4b8d-9a48-bdba9e56637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bf63ca-ef19-4b8d-9a48-bdba9e56637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-644841432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dec91a-ed3c-4fea-8d97-939de70897e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d175c4d0d11476e9169e90190f3e37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:25Z,use_quota=True,user_id='c93c40948449403f8439d9d2d00ca257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39afcba5-0272-4ecb-8be3-1344952e2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39afcba5-0272-4ecb-8be3-1344952e2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ffaa78-aff0-4144-8679-c2f2697078ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ffaa78-aff0-4144-8679-c2f2697078ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9dec91a-ed3c-4fea-8d97-939de70897e5', 'volume_name': 'volume-d9dec91a-ed3c-4fea-8d97-939de70897e5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb85e73-f7ab-4501-a366-0c0faffe37cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb85e73-f7ab-4501-a366-0c0faffe37cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6718ee9-efa1-472e-b251-37f7e234f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Volume d9dec91a-ed3c-4fea-8d97-939de70897e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9dec91a-ed3c-4fea-8d97-939de70897e5', 'volume_size': 1} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-644841432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dec91a-ed3c-4fea-8d97-939de70897e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d175c4d0d11476e9169e90190f3e37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:25Z,use_quota=True,user_id='c93c40948449403f8439d9d2d00ca257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Creating volume d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:02:24 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:02:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:24 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 1073741824 Apr 28 05:02:24 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:25 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 1073741824" returned: 0 in 0.579s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:25 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:25 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:25 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6718ee9-efa1-472e-b251-37f7e234f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9dec91a-ed3c-4fea-8d97-939de70897e5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa864a24-fdbc-4eae-a702-d9d07dbefce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Volume volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 (d9dec91a-ed3c-4fea-8d97-939de70897e5): created successfully Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa864a24-fdbc-4eae-a702-d9d07dbefce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Flow 'volume_create_manager' (fd9bba62-4759-43b9-9b95-0d515fe42670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0654f6d1-ce76-460a-b09a-3309544ec505 tempest-VolumesCloneTest-2066173824 None] Created volume successfully. Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Flow 'volume_create_manager' (1f5aa1cf-ad40-4864-a147-17f28de54abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bd5300-3c55-4660-b648-820469ef8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bd5300-3c55-4660-b648-820469ef8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-768821180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbad8d45-fb7e-46be-bab1-91bbb3092843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d175c4d0d11476e9169e90190f3e37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d9dec91a-ed3c-4fea-8d97-939de70897e5,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:27Z,use_quota=True,user_id='c93c40948449403f8439d9d2d00ca257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1a2960-b867-431e-9f8b-54f089007c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1a2960-b867-431e-9f8b-54f089007c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b6d4a8-dc90-4911-8f1e-c38071cb77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b6d4a8-dc90-4911-8f1e-c38071cb77dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bbad8d45-fb7e-46be-bab1-91bbb3092843', 'volume_name': 'volume-bbad8d45-fb7e-46be-bab1-91bbb3092843', 'volume_size': 2, 'source_volid': 'd9dec91a-ed3c-4fea-8d97-939de70897e5', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1f9aa-bc22-4ec8-9f68-80228f4a209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1f9aa-bc22-4ec8-9f68-80228f4a209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21898d56-20ec-4a8a-9189-2fee130b5bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Volume bbad8d45-fb7e-46be-bab1-91bbb3092843: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bbad8d45-fb7e-46be-bab1-91bbb3092843', 'volume_size': 2, 'source_volid': 'd9dec91a-ed3c-4fea-8d97-939de70897e5', 'source_volstatus': 'available'} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:27 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Cloning volume d9dec91a-ed3c-4fea-8d97-939de70897e5 to volume bbad8d45-fb7e-46be-bab1-91bbb3092843 Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Creating offline snapshot 8f034eac-8dab-4801-bfb5-e5fc71df44c4 of volume d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba9d6e1-ac4a-46be-a3e3-97de91118ddc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:27 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:27 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:27 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.507s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:27 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 1G Apr 28 05:02:27 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:28 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 1G" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:28 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:28 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:28 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.478s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:28 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 is being set with open permissions: ugo+rw Apr 28 05:02:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:28 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:28 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:29 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.426s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:29 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info Apr 28 05:02:29 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:29 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:29 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info is being set with open permissions: ugo+rw Apr 28 05:02:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:29 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info Apr 28 05:02:29 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:30 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.info" returned: 0 in 0.428s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] snapshot: 8f034eac-8dab-4801-bfb5-e5fc71df44c4, volume: bbad8d45-fb7e-46be-bab1-91bbb3092843, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da59481-4728-48ae-8796-ae255729514a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:30 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:30 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:30 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9dec91a-ed3c-4fea-8d97-939de70897e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8dc00a-d767-4711-9589-aaf5972b8fb3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:30 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:30 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:31 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.501s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:31 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:02:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:31 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 Apr 28 05:02:31 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:35 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843" returned: 0 in 4.397s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9991b31-5583-4ca5-861f-a7956bbc873d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:35 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:35 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:36 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:02:36 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Converted 1024.00 MB image at 232.78 MB/s Apr 28 05:02:36 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 is being set with open permissions: ugo+rw Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:36 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 Apr 28 05:02:36 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:36 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843" returned: 0 in 0.423s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" released by "_copy_volume_from_snapshot" :: held 6.536s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-quobyte-8f034eac-8dab-4801-bfb5-e5fc71df44c4" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-8f034eac-8dab-4801-bfb5-e5fc71df44c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Deleting offline snapshot 8f034eac-8dab-4801-bfb5-e5fc71df44c4 of volume d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] snapshot_file for this snap is: volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e67bf-7083-4553-9ab9-a56af3a3dde2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:36 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:36 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:37 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.505s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9dec91a-ed3c-4fea-8d97-939de70897e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99302496-215a-4900-8931-857a49c986d8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:37 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:37 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:37 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.506s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:37 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:37 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:38 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.521s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:38 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4 Apr 28 05:02:38 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:38 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5.8f034eac-8dab-4801-bfb5-e5fc71df44c4" returned: 0 in 0.431s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-8f034eac-8dab-4801-bfb5-e5fc71df44c4" released by "_delete_snapshot" :: held 2.056s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.636s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21898d56-20ec-4a8a-9189-2fee130b5bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbad8d45-fb7e-46be-bab1-91bbb3092843', 'volume_size': 2, 'source_volid': 'd9dec91a-ed3c-4fea-8d97-939de70897e5', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3bdb3d-948c-41a1-9620-db02cebe2168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:38 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Volume volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 (bbad8d45-fb7e-46be-bab1-91bbb3092843): created successfully Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3bdb3d-948c-41a1-9620-db02cebe2168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Flow 'volume_create_manager' (1f5aa1cf-ad40-4864-a147-17f28de54abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d2c5425f-3225-46b5-8a0a-88ab1684d8b6 tempest-VolumesCloneTest-2066173824 None] Created volume successfully. Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-bbad8d45-fb7e-46be-bab1-91bbb3092843-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-bbad8d45-fb7e-46be-bab1-91bbb3092843-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b802185-e795-4dcc-b1a5-9235fd573369]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:40 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 Apr 28 05:02:40 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:40 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843" returned: 0 in 0.492s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:40 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843 Apr 28 05:02:40 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:41 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-bbad8d45-fb7e-46be-bab1-91bbb3092843" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-bbad8d45-fb7e-46be-bab1-91bbb3092843" released by "delete_volume" :: held 0.972s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Created reservations ['7625c395-2341-44f1-962c-cb65a2f48fea', 'd82e2ebd-87b3-4d10-b4b2-642f2502b090', 'cefa52ce-b6bd-4324-abae-d8db291b720d', '27a1ec13-a2cb-45fb-969d-69e41aea71a2'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:41 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:41 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:41 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Deleted volume successfully. Apr 28 05:02:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561ab77c-b48a-4a33-9754-dd72434cb950 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-bbad8d45-fb7e-46be-bab1-91bbb3092843-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-d9dec91a-ed3c-4fea-8d97-939de70897e5-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-d9dec91a-ed3c-4fea-8d97-939de70897e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "cinder-quobyte-d9dec91a-ed3c-4fea-8d97-939de70897e5" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-d9dec91a-ed3c-4fea-8d97-939de70897e5" acquired by "delete_volume" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a465b1-69c6-4910-9532-2d3a7e1ac1b6]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:42 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:42 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:42 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:42 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5 Apr 28 05:02:42 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:43 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-d9dec91a-ed3c-4fea-8d97-939de70897e5" returned: 0 in 0.424s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-quobyte-d9dec91a-ed3c-4fea-8d97-939de70897e5" released by "delete_volume" :: held 0.981s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Created reservations ['22714bd1-1e77-4228-971b-23a8707e26e7', '73194858-be73-40cc-a6a2-32938569f551', '01ca1151-68d7-4737-8e07-d37025db52df', 'ca01ee72-9614-45da-8065-45ac73ba2d40'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:43 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:43 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:43 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.434s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Deleted volume successfully. Apr 28 05:02:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-54b63ccd-0073-4d49-8f78-d8e67f306915 tempest-VolumesCloneTest-2066173824 None] Lock "cinder-d9dec91a-ed3c-4fea-8d97-939de70897e5-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=2 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (881004e5-7ed2-481a-9f39-4fbb9df3a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf8a30-7817-4e3e-b886-4b219a2517e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf8a30-7817-4e3e-b886-4b219a2517e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1227533291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0308f93f-0764-4bf9-952d-6ef800ed18c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:47Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac6b517-feec-4c30-81bd-61cdb7ee76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac6b517-feec-4c30-81bd-61cdb7ee76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba811b-2d99-4940-ae35-638874931e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba811b-2d99-4940-ae35-638874931e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0308f93f-0764-4bf9-952d-6ef800ed18c0', 'volume_name': 'volume-0308f93f-0764-4bf9-952d-6ef800ed18c0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ed644-e0fc-44d7-b150-23af4eee63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ed644-e0fc-44d7-b150-23af4eee63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d461221a-5d4e-4c7b-857d-805958767e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:46 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Volume 0308f93f-0764-4bf9-952d-6ef800ed18c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0308f93f-0764-4bf9-952d-6ef800ed18c0', 'volume_size': 1} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1227533291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0308f93f-0764-4bf9-952d-6ef800ed18c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:47Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Creating volume 0308f93f-0764-4bf9-952d-6ef800ed18c0 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:02:46 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:02:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:46 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 1073741824 Apr 28 05:02:46 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:47 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 1073741824" returned: 0 in 0.608s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:47 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 Apr 28 05:02:47 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:48 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0" returned: 0 in 0.446s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d461221a-5d4e-4c7b-857d-805958767e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0308f93f-0764-4bf9-952d-6ef800ed18c0', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bafe8a-5eec-4e84-ad00-d5ca9158e5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:48 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Volume volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 (0308f93f-0764-4bf9-952d-6ef800ed18c0): created successfully Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bafe8a-5eec-4e84-ad00-d5ca9158e5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:48 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (881004e5-7ed2-481a-9f39-4fbb9df3a673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b7d9d401-d2d3-4ed7-afca-44c0e02c6a72 tempest-VolumesListTestJSON-680903394 None] Created volume successfully. Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (8019401f-3b9e-4938-8678-3b8c5ed628af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2be86f-7c20-4bdc-a5e2-0f47eb1bea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2be86f-7c20-4bdc-a5e2-0f47eb1bea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-578978072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db11cdff-241f-4df0-be55-8f3fd051e41b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:49Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa86c5e9-7f89-4320-9933-2875f7826f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa86c5e9-7f89-4320-9933-2875f7826f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebeac445-c880-401a-bea8-7a70d6e779c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebeac445-c880-401a-bea8-7a70d6e779c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db11cdff-241f-4df0-be55-8f3fd051e41b', 'volume_name': 'volume-db11cdff-241f-4df0-be55-8f3fd051e41b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863ad10-1d78-4085-83ac-c3821d8b0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863ad10-1d78-4085-83ac-c3821d8b0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e4088-12e3-474a-afc7-d84ae4abadea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:49 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Volume db11cdff-241f-4df0-be55-8f3fd051e41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db11cdff-241f-4df0-be55-8f3fd051e41b', 'volume_size': 1} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-578978072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db11cdff-241f-4df0-be55-8f3fd051e41b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:49Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Creating volume db11cdff-241f-4df0-be55-8f3fd051e41b {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:02:49 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:49 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b 1073741824 Apr 28 05:02:49 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:49 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b 1073741824" returned: 0 in 0.594s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:50 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b Apr 28 05:02:50 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:50 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b" returned: 0 in 0.438s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e4088-12e3-474a-afc7-d84ae4abadea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db11cdff-241f-4df0-be55-8f3fd051e41b', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc5fa2b-1380-40a5-8fdc-b66403611c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:50 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Volume volume-db11cdff-241f-4df0-be55-8f3fd051e41b (db11cdff-241f-4df0-be55-8f3fd051e41b): created successfully Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc5fa2b-1380-40a5-8fdc-b66403611c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:50 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (8019401f-3b9e-4938-8678-3b8c5ed628af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:50 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-659917e1-ec6a-47c6-bbc2-474d280694a0 tempest-VolumesListTestJSON-680903394 None] Created volume successfully. Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (d903aa51-61a1-4c17-97cc-ff04428e2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cdc4d1-eaa8-4532-be17-2b1d4f16d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cdc4d1-eaa8-4532-be17-2b1d4f16d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-687674811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0879b3-3b14-4d3d-acb5-f6a57e0ba255,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:52Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdcedba-65df-4882-8ad0-6ed2ccb16fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdcedba-65df-4882-8ad0-6ed2ccb16fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38f242d-faca-4506-8769-da476a231e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38f242d-faca-4506-8769-da476a231e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0879b3-3b14-4d3d-acb5-f6a57e0ba255', 'volume_name': 'volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0582b2-5d73-4ac5-a52c-82c139a7a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0582b2-5d73-4ac5-a52c-82c139a7a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be048da2-31dd-47b8-b1ee-6a85914529f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:51 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Volume 0c0879b3-3b14-4d3d-acb5-f6a57e0ba255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255', 'volume_size': 1} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-687674811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0879b3-3b14-4d3d-acb5-f6a57e0ba255,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4e683123384cb1aaae8d41cd395b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:02:52Z,use_quota=True,user_id='3d7d931f1ad647a6824a31283a472ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Creating volume 0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:02:51 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:02:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:51 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 1073741824 Apr 28 05:02:51 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:52 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 1073741824" returned: 0 in 0.592s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:52 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 Apr 28 05:02:52 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:52 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" returned: 0 in 0.431s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be048da2-31dd-47b8-b1ee-6a85914529f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20251f5-763e-48a9-ad92-1e2cb1149be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:02:52 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Volume volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 (0c0879b3-3b14-4d3d-acb5-f6a57e0ba255): created successfully Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20251f5-763e-48a9-ad92-1e2cb1149be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:02:52 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Flow 'volume_create_manager' (d903aa51-61a1-4c17-97cc-ff04428e2b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:02:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8ae15fce-3fcd-4ef3-a82f-d20c55b1f4f8 tempest-VolumesListTestJSON-680903394 None] Created volume successfully. Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-quobyte-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df9484-e09c-4669-ba2a-78efa65ca07e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:56 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 Apr 28 05:02:56 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:56 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:56 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:56 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" returned: 0 in 0.505s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:56 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255 Apr 28 05:02:56 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:56 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.421s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:56 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:57 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255" released by "delete_volume" :: held 0.990s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Created reservations ['2fdee99f-960b-4107-b014-928a3f37851e', 'ab6bcbe4-66d0-4040-bd3c-7d26085eef66', '077c01be-822a-401e-88e9-70ecaeeb566c', 'cd20ffd7-f028-4641-b7a9-6ddab6df8fa7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:57 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:57 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:57 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.422s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:57 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Deleted volume successfully. Apr 28 05:02:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-4fac3179-3099-4251-a91d-6e4f92796170 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-0c0879b3-3b14-4d3d-acb5-f6a57e0ba255-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-db11cdff-241f-4df0-be55-8f3fd051e41b-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-db11cdff-241f-4df0-be55-8f3fd051e41b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-quobyte-db11cdff-241f-4df0-be55-8f3fd051e41b" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-db11cdff-241f-4df0-be55-8f3fd051e41b" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5416f2f0-cdfe-4665-bf42-93eceee5ed1a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:58 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b Apr 28 05:02:58 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:58 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:58 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b Apr 28 05:02:58 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:59 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-db11cdff-241f-4df0-be55-8f3fd051e41b" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-db11cdff-241f-4df0-be55-8f3fd051e41b" released by "delete_volume" :: held 0.990s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Created reservations ['4825d014-836c-4ce1-99e5-14ca5d63c0ce', '45d12ad2-8200-40a0-b237-ee80823d033d', '45da2d7d-65f5-4b19-b94d-236bcdc95171', '97309a0d-070d-4d69-8fad-d5beb9ff6843'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:02:59 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:02:59 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:02:59 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.418s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:02:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Deleted volume successfully. Apr 28 05:02:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-376129f4-72cc-4a32-b55c-b33e36e567a9 tempest-VolumesListTestJSON-680903394 None] Lock "cinder-db11cdff-241f-4df0-be55-8f3fd051e41b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-0308f93f-0764-4bf9-952d-6ef800ed18c0-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "cinder-0308f93f-0764-4bf9-952d-6ef800ed18c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Acquiring lock "cinder-quobyte-0308f93f-0764-4bf9-952d-6ef800ed18c0" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-0308f93f-0764-4bf9-952d-6ef800ed18c0" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[088c571d-a82a-4cb0-8909-7e0ffc3fee9e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:00 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 Apr 28 05:03:00 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:01 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0" returned: 0 in 0.501s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:01 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0 Apr 28 05:03:01 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:01 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0308f93f-0764-4bf9-952d-6ef800ed18c0" returned: 0 in 0.423s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "cinder-quobyte-0308f93f-0764-4bf9-952d-6ef800ed18c0" released by "delete_volume" :: held 0.969s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Created reservations ['39db7e84-9a08-4a7b-90fb-defb0fe5c4b1', 'c35e0a41-a072-4d66-9cb3-79710855600b', '4e0d59e5-e2b8-4993-b6b5-2c688c0ddf8b', 'a3478b29-e626-40d7-8544-98abf5944dee'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:01 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:03:01 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:02 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.462s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:02 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:03:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Deleted volume successfully. Apr 28 05:03:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-31776917-4927-4864-af1b-59a22ab9ebcc tempest-VolumesListTestJSON-680903394 None] Lock "cinder-0308f93f-0764-4bf9-952d-6ef800ed18c0-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (a97d1f85-97c9-4e0a-9f0b-044c09d8616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d27a59-3ce8-4b23-9f75-be8b938bbe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d27a59-3ce8-4b23-9f75-be8b938bbe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-689260804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d02ec6-b72f-4f70-b42e-402f9b42246d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:11Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ddd3a-c879-4783-add0-c7d2585b44f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ddd3a-c879-4783-add0-c7d2585b44f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4370ff7e-f224-4e02-bd02-8e2ff7cb3777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4370ff7e-f224-4e02-bd02-8e2ff7cb3777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d02ec6-b72f-4f70-b42e-402f9b42246d', 'volume_name': 'volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe15e88c-cbd7-4a5a-8b2d-4a408299c783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe15e88c-cbd7-4a5a-8b2d-4a408299c783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de7fd5a-750b-452e-b7e0-c3e7764d1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:11 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Volume f3d02ec6-b72f-4f70-b42e-402f9b42246d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d', 'volume_size': 1} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-689260804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d02ec6-b72f-4f70-b42e-402f9b42246d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:11Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Creating volume f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:03:11 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:11 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d 1073741824 Apr 28 05:03:11 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:11 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d 1073741824" returned: 0 in 0.577s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:12 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d Apr 28 05:03:12 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:12 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d" returned: 0 in 0.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de7fd5a-750b-452e-b7e0-c3e7764d1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c83063-b067-4d73-b712-e4398f2d80b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:12 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Volume volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d (f3d02ec6-b72f-4f70-b42e-402f9b42246d): created successfully Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c83063-b067-4d73-b712-e4398f2d80b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (a97d1f85-97c9-4e0a-9f0b-044c09d8616c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-303948c4-3e46-4897-aeb7-21dbcb5a75e0 tempest-VolumesSnapshotTestJSON-522987023 None] Created volume successfully. Apr 28 05:03:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Creating offline snapshot 7c0716de-635b-4299-8e84-b8089f5b2cb6 of volume f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:03:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f981fe-852c-4332-863e-f760805feb6f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:13 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d Apr 28 05:03:13 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:14 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d" returned: 0 in 0.513s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:14 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 1G Apr 28 05:03:14 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:14 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 1G" returned: 0 in 0.591s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:14 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 Apr 28 05:03:14 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:15 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:15 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 is being set with open permissions: ugo+rw Apr 28 05:03:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:15 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 Apr 28 05:03:15 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:15 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6" returned: 0 in 0.436s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:15 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info Apr 28 05:03:15 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:16 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info" returned: 0 in 0.437s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:16 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info is being set with open permissions: ugo+rw Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:16 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info Apr 28 05:03:16 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:16 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.info" returned: 0 in 0.422s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:16 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cf1b2234-e8a3-4f68-83fb-f6813183eca3 tempest-VolumesSnapshotTestJSON-522987023 None] Create snapshot completed successfully Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-7c0716de-635b-4299-8e84-b8089f5b2cb6-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-7c0716de-635b-4299-8e84-b8089f5b2cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-7c0716de-635b-4299-8e84-b8089f5b2cb6" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-7c0716de-635b-4299-8e84-b8089f5b2cb6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Deleting offline snapshot 7c0716de-635b-4299-8e84-b8089f5b2cb6 of volume f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] snapshot_file for this snap is: volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5048a3e5-f259-418b-8dba-ce38b2a9d3bf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:17 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 Apr 28 05:03:17 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:17 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6" returned: 0 in 0.561s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbd5aa-e17b-414c-954a-2e3d613dfd84]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:17 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d Apr 28 05:03:17 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:18 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:18 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 Apr 28 05:03:18 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:18 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6" returned: 0 in 0.536s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:18 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6 Apr 28 05:03:18 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:19 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d.7c0716de-635b-4299-8e84-b8089f5b2cb6" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-7c0716de-635b-4299-8e84-b8089f5b2cb6" released by "_delete_snapshot" :: held 2.148s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" released by "delete_snapshot" :: held 2.170s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:19 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['1426f8ba-8c37-4456-ac06-57901de806ba', '5bcd64cb-7a17-4592-bfd4-f142e4539853', 'afcf019d-fa7e-4189-af01-43b45a0c1d8e', 'c53a58b0-2033-4cee-94a6-0820836af5d0'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:19 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Delete snapshot completed successfully. Apr 28 05:03:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-992a7941-cfdd-4f6d-8ac5-52e364b11fc5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-7c0716de-635b-4299-8e84-b8089f5b2cb6-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (678f6922-9cba-4fa3-8a2c-259a4f77da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4864fd0e-5560-4651-a5de-b0a0e8203130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4864fd0e-5560-4651-a5de-b0a0e8203130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1882272837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:20Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d6b7b5-bc0a-4810-8c4b-813d55d05293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d6b7b5-bc0a-4810-8c4b-813d55d05293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c01cbf6-c835-441b-875f-6a4b6f9f5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c01cbf6-c835-441b-875f-6a4b6f9f5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4', 'volume_name': 'volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e31e707-83a2-41ef-aaa0-bf728a2fa322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e31e707-83a2-41ef-aaa0-bf728a2fa322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80051d8-1c3a-409c-8008-5180c7ccdf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:20 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Volume 00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4', 'volume_size': 1} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1882272837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:20Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Creating volume 00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:03:20 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:03:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:20 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 1073741824 Apr 28 05:03:20 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:21 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 1073741824" returned: 0 in 0.612s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:21 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:21 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:21 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.416s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80051d8-1c3a-409c-8008-5180c7ccdf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5d59de-f0ae-4509-8a73-ba11674b1526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:21 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Volume volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 (00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4): created successfully Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5d59de-f0ae-4509-8a73-ba11674b1526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:21 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (678f6922-9cba-4fa3-8a2c-259a4f77da1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-060f08de-6e7d-4ad0-b647-1c20f77bead5 tempest-VolumesSnapshotTestJSON-522987023 None] Created volume successfully. Apr 28 05:03:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Creating offline snapshot 6cd82030-ac7b-442b-81a9-072141950a91 of volume 00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:03:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aabbe5d-1691-448d-98ee-1e0548552cf1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:22 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:22 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:23 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.494s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:23 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 1G Apr 28 05:03:23 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:23 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 1G" returned: 0 in 0.647s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:23 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:23 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:24 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.476s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:24 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 is being set with open permissions: ugo+rw Apr 28 05:03:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:24 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:24 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:24 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.440s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:24 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info Apr 28 05:03:24 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:25 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:25 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info is being set with open permissions: ugo+rw Apr 28 05:03:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:25 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info Apr 28 05:03:25 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:25 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.info" returned: 0 in 0.458s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b027707c-d920-4785-b575-489d6b267107 tempest-VolumesSnapshotTestJSON-522987023 None] Create snapshot completed successfully Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (ab44dc98-78d2-483e-81fe-8a09bff70ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbc6dec-05ae-47a8-8848-e19233ed0a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbc6dec-05ae-47a8-8848-e19233ed0a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1096399786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6cd82030-ac7b-442b-81a9-072141950a91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:27Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b23c27-c83c-4468-8d04-2819132e1b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b23c27-c83c-4468-8d04-2819132e1b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c93b73-5a28-43b8-bb27-1da4feeb02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c93b73-5a28-43b8-bb27-1da4feeb02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20', 'volume_name': 'volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20', 'volume_size': 2, 'snapshot_id': '6cd82030-ac7b-442b-81a9-072141950a91'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0473c33-6a59-47d4-9c9f-6fdd8e0ebdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0473c33-6a59-47d4-9c9f-6fdd8e0ebdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c391395-1638-4ad1-8220-66e26d1a7e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Volume e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20', 'volume_size': 2, 'snapshot_id': '6cd82030-ac7b-442b-81a9-072141950a91'} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Creating volume e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 from snapshot 6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] snapshot: 6cd82030-ac7b-442b-81a9-072141950a91, volume: e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d650bf48-0df5-4549-b8bf-b61f1fe1d8d3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:27 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:27 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:27 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.515s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae0641-91a4-452b-9569-100447416ddc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:28 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:28 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:28 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.528s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:28 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:03:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:28 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 Apr 28 05:03:28 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:32 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" returned: 0 in 4.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd84fe6-9cc0-46da-9f43-86c965c0691c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:33 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:33 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:33 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.645s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:33 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:03:33 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Converted 1024.00 MB image at 229.59 MB/s Apr 28 05:03:33 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 is being set with open permissions: ugo+rw Apr 28 05:03:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:33 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 Apr 28 05:03:33 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:34 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" returned: 0 in 0.430s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" released by "_copy_volume_from_snapshot" :: held 6.669s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" released by "_create_volume_from_snapshot" :: held 6.697s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.714s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c391395-1638-4ad1-8220-66e26d1a7e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20', 'volume_size': 2, 'snapshot_id': '6cd82030-ac7b-442b-81a9-072141950a91'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa784f6f-27f5-4a82-9239-82139e4dc5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:34 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Volume volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 (e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20): created successfully Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa784f6f-27f5-4a82-9239-82139e4dc5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (ab44dc98-78d2-483e-81fe-8a09bff70ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b8a340d8-58b0-490b-b471-6af14b9219fe tempest-VolumesSnapshotTestJSON-522987023 None] Created volume successfully. Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" acquired by "delete_volume" :: waited 0.013s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684133e-898e-410f-86ad-4557f86e83ff]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:35 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 Apr 28 05:03:35 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:35 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" returned: 0 in 0.526s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:35 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20 Apr 28 05:03:35 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:35 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" returned: 0 in 0.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20" released by "delete_volume" :: held 1.005s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['9326e322-c7c3-4f52-bec0-b3dab5ecc716', '04175685-710d-4641-83ed-2e9bfea12dee', '6e94d932-445a-4d5f-a741-b6b9ec02d5af', '3f353eab-ed98-4994-8feb-2d3beaef7f09'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:36 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:03:36 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:36 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:03:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Deleted volume successfully. Apr 28 05:03:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-561cd6eb-f39c-4ea5-8ef7-40815887b239 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-e7bec350-42cd-4d4f-b4e5-fc8e0e94ef20-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-6cd82030-ac7b-442b-81a9-072141950a91-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-6cd82030-ac7b-442b-81a9-072141950a91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Deleting offline snapshot 6cd82030-ac7b-442b-81a9-072141950a91 of volume 00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] snapshot_file for this snap is: volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0148f29-4f97-499b-ba88-daaf8baaf5f8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:37 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:37 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:37 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.516s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42737cd0-91d6-4fc7-af21-bef096c8452f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:37 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:37 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:38 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.520s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:38 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:38 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:38 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.538s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:38 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91 Apr 28 05:03:38 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:39 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4.6cd82030-ac7b-442b-81a9-072141950a91" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=75,cinder:DELETE=10,cinder:SELECT=56,cinder:INSERT=20 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-6cd82030-ac7b-442b-81a9-072141950a91" released by "_delete_snapshot" :: held 2.127s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" released by "delete_snapshot" :: held 2.158s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['f86b9f1d-19fd-401b-a925-7261d719966e', '2070b30c-1f30-4d4f-ae54-d15914ab2027', '17ffb086-620c-4d31-8208-c09a6e6fdaeb', 'cb227545-4ee8-405a-8dc8-4d9751e0868d'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:39 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Delete snapshot completed successfully. Apr 28 05:03:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-1b6c0278-9bf9-4fed-ab22-be156aa2e7c2 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-6cd82030-ac7b-442b-81a9-072141950a91-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c13819-0ade-4663-a50f-28f7b11ed681]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:40 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:40 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:41 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:41 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4 Apr 28 05:03:41 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:41 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" returned: 0 in 0.447s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4" released by "delete_volume" :: held 1.013s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['22ada38d-6699-44e7-9dcd-b6a7ba477ac0', '9cf06e29-f870-455c-962f-30542a3fb0d8', '93e46907-d675-4b8b-8de8-69c7fa07f320', 'cc3f14c3-1051-44c4-8946-756485237dc3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:41 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:03:41 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:42 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.436s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:03:42 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Deleted volume successfully. Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6cd8bbc8-1567-4e3e-b088-626447cc0eab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-00e4fe51-d0d0-4866-8d2b-8ecf2a053cc4-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (7a46d288-7150-45b8-9077-861742f4da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4037177-4177-4e6d-8536-358431cc63aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4037177-4177-4e6d-8536-358431cc63aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109537794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621c056b-8b2c-45ca-8d82-5210558be9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:43Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47279f9d-e49f-4ece-81e1-011d40b25e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47279f9d-e49f-4ece-81e1-011d40b25e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1c5115-3cbd-4abc-bc9a-68a347d09200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1c5115-3cbd-4abc-bc9a-68a347d09200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621c056b-8b2c-45ca-8d82-5210558be9e2', 'volume_name': 'volume-621c056b-8b2c-45ca-8d82-5210558be9e2', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7da30-d334-4f58-a7b2-cf490165c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7da30-d334-4f58-a7b2-cf490165c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509472e7-952e-435b-835a-7fdd2fc56421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:43 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Volume 621c056b-8b2c-45ca-8d82-5210558be9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621c056b-8b2c-45ca-8d82-5210558be9e2', 'volume_size': 1} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109537794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621c056b-8b2c-45ca-8d82-5210558be9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:43Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Creating volume 621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:03:43 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:43 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 1073741824 Apr 28 05:03:43 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:43 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 1073741824" returned: 0 in 0.591s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:43 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:03:43 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:44 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.475s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509472e7-952e-435b-835a-7fdd2fc56421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621c056b-8b2c-45ca-8d82-5210558be9e2', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b019b9c3-0593-494f-aeb9-a3adabedc0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:44 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Volume volume-621c056b-8b2c-45ca-8d82-5210558be9e2 (621c056b-8b2c-45ca-8d82-5210558be9e2): created successfully Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b019b9c3-0593-494f-aeb9-a3adabedc0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:44 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (7a46d288-7150-45b8-9077-861742f4da1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:44 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d71f34f0-2f7f-43ff-82e9-2544528ffaab tempest-VolumesSnapshotTestJSON-522987023 None] Created volume successfully. Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Creating offline snapshot a17718c2-fe15-47e3-b38b-c118fdc893be of volume 621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba9615d-67f7-4b68-b906-7a3625129806]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:45 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:03:45 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:45 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:45 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be 1G Apr 28 05:03:45 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:46 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be 1G" returned: 0 in 0.602s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621c056b-8b2c-45ca-8d82-5210558be9e2 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:46 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621c056b-8b2c-45ca-8d82-5210558be9e2 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:03:46 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:46 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621c056b-8b2c-45ca-8d82-5210558be9e2 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.474s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:46 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be is being set with open permissions: ugo+rw Apr 28 05:03:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:46 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:03:46 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:47 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.465s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:47 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:UPDATE=76,cinder:SELECT=71,cinder:INSERT=21,cinder:DELETE=5 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:03:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:47 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info Apr 28 05:03:47 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:47 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:47 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info is being set with open permissions: ugo+rw Apr 28 05:03:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:47 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info Apr 28 05:03:47 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:48 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.info" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:48 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-220cc9c2-a17e-4e9d-a2b2-97fe267103db tempest-VolumesSnapshotTestJSON-522987023 None] Create snapshot completed successfully Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (787aac70-8882-423b-9388-19dddd8a4b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1b13a0-ceff-497e-bedf-00f4814e68d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1b13a0-ceff-497e-bedf-00f4814e68d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2087152830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a337784-e84a-4e97-9f32-759863fb493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f08638b93ad48cab0662299f757b167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a17718c2-fe15-47e3-b38b-c118fdc893be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:03:50Z,use_quota=True,user_id='5a8beeed65284e15b605403f08bb7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db046b9-25ae-472c-8bcf-76e8da93ecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db046b9-25ae-472c-8bcf-76e8da93ecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1816622-a542-4e66-ac08-e60d0d5b9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1816622-a542-4e66-ac08-e60d0d5b9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a337784-e84a-4e97-9f32-759863fb493e', 'volume_name': 'volume-0a337784-e84a-4e97-9f32-759863fb493e', 'volume_size': 1, 'snapshot_id': 'a17718c2-fe15-47e3-b38b-c118fdc893be'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8148f9de-ba8f-41c6-99ac-9f9e846fdb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8148f9de-ba8f-41c6-99ac-9f9e846fdb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ee685-cc27-4663-9fb7-d5246070d320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:49 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Volume 0a337784-e84a-4e97-9f32-759863fb493e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a337784-e84a-4e97-9f32-759863fb493e', 'volume_size': 1, 'snapshot_id': 'a17718c2-fe15-47e3-b38b-c118fdc893be'} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be-0a337784-e84a-4e97-9f32-759863fb493e" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be-0a337784-e84a-4e97-9f32-759863fb493e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Creating volume 0a337784-e84a-4e97-9f32-759863fb493e from snapshot a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] snapshot: a17718c2-fe15-47e3-b38b-c118fdc893be, volume: 0a337784-e84a-4e97-9f32-759863fb493e, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3b7750-9c40-48d3-adf3-53042f62a3cb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:50 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:03:50 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:50 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.528s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621c056b-8b2c-45ca-8d82-5210558be9e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b248803-336f-42aa-ab2b-d467618b2ea0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:50 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:03:50 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:51 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.524s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:51 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:03:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:51 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e Apr 28 05:03:51 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:55 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e" returned: 0 in 4.570s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:55 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e55ec66-4d76-4df7-bd8a-8c4974a4cf00]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:55 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:03:55 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:56 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.653s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:03:56 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Converted 1024.00 MB image at 224.02 MB/s Apr 28 05:03:56 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e is being set with open permissions: ugo+rw Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:56 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e Apr 28 05:03:56 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:56 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:03:56 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:56 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e" returned: 0 in 0.435s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" released by "_copy_volume_from_snapshot" :: held 6.801s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be-0a337784-e84a-4e97-9f32-759863fb493e" released by "_create_volume_from_snapshot" :: held 6.830s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.845s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ee685-cc27-4663-9fb7-d5246070d320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a337784-e84a-4e97-9f32-759863fb493e', 'volume_size': 1, 'snapshot_id': 'a17718c2-fe15-47e3-b38b-c118fdc893be'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77432408-ba3a-4da1-a8a3-1896049aa777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:03:56 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Volume volume-0a337784-e84a-4e97-9f32-759863fb493e (0a337784-e84a-4e97-9f32-759863fb493e): created successfully Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77432408-ba3a-4da1-a8a3-1896049aa777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Flow 'volume_create_manager' (787aac70-8882-423b-9388-19dddd8a4b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:03:56 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-12c89663-72a3-4c2b-9fe0-404b2bea56dc tempest-VolumesSnapshotTestJSON-522987023 None] Created volume successfully. Apr 28 05:03:56 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.430s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:56 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-0a337784-e84a-4e97-9f32-759863fb493e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-0a337784-e84a-4e97-9f32-759863fb493e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4439901-fdf4-4c2e-ad65-e1db312c4776]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:57 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e Apr 28 05:03:57 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:58 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e" returned: 0 in 0.500s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:58 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e Apr 28 05:03:58 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:58 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-0a337784-e84a-4e97-9f32-759863fb493e" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-0a337784-e84a-4e97-9f32-759863fb493e" released by "delete_volume" :: held 0.982s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['7cb2123f-42e9-4cca-8315-a886da27af66', 'fffed9a0-b41e-43cf-8864-42d6778b18fc', '2fa57ef4-9b02-456d-a170-dd59d4e3ee96', '64a6c804-2522-4e3d-8db3-9a6dfdd7e59a'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:03:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:58 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:03:58 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:03:59 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.454s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:03:59 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Deleted volume successfully. Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-339fd46a-11ee-4276-be2c-9a0476423f3c tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-0a337784-e84a-4e97-9f32-759863fb493e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-a17718c2-fe15-47e3-b38b-c118fdc893be-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-a17718c2-fe15-47e3-b38b-c118fdc893be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Deleting offline snapshot a17718c2-fe15-47e3-b38b-c118fdc893be of volume 621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] snapshot_file for this snap is: volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533365d-062a-49b4-8330-7f897cb7b9a5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:03:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:03:59 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:03:59 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:00 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.523s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621c056b-8b2c-45ca-8d82-5210558be9e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b913154-80ce-48cb-9d43-00d162641c66]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:00 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:04:00 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:00 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.513s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:00 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:04:00 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:01 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:01 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be Apr 28 05:04:01 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:01 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2.a17718c2-fe15-47e3-b38b-c118fdc893be" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-a17718c2-fe15-47e3-b38b-c118fdc893be" released by "_delete_snapshot" :: held 2.135s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" released by "delete_snapshot" :: held 2.160s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:01 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['48036fa1-e413-4ef2-be2b-b103a0d67a13', '010d0302-8419-4645-b022-8e85dc78bd07', '3cb219e0-fde6-42e3-9f05-00b575b8262d', '87429e71-6f08-4be5-809a-599b757c9050'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Delete snapshot completed successfully. Apr 28 05:04:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5af2fbb9-13b1-41e8-8958-ec9bdc307493 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-a17718c2-fe15-47e3-b38b-c118fdc893be-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-621c056b-8b2c-45ca-8d82-5210558be9e2-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-621c056b-8b2c-45ca-8d82-5210558be9e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacd382b-4c73-4e3b-b27b-870175705f0d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:03 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:04:03 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:03 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.558s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:03 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2 Apr 28 05:04:03 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:04 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-621c056b-8b2c-45ca-8d82-5210558be9e2" returned: 0 in 0.474s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-621c056b-8b2c-45ca-8d82-5210558be9e2" released by "delete_volume" :: held 1.093s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['5befcadd-0670-4a60-81ee-1f9bcd435781', '5ff4ac95-4891-4c23-b3e2-995fe6a90579', 'cf77abf7-bd0f-4d41-8048-a310b142d9d9', 'd060c47b-7986-4a0e-802b-68bbeeb57881'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:04 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:04 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:04 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.434s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Deleted volume successfully. Apr 28 05:04:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-50b3ef36-7685-4893-b975-772f87036af0 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-621c056b-8b2c-45ca-8d82-5210558be9e2-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-f3d02ec6-b72f-4f70-b42e-402f9b42246d-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-f3d02ec6-b72f-4f70-b42e-402f9b42246d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e0d62-4c9d-4a7b-8c7a-1192e5bca7df]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:05 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d Apr 28 05:04:05 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:05 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d" returned: 0 in 0.514s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:05 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d Apr 28 05:04:05 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:06 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d02ec6-b72f-4f70-b42e-402f9b42246d" returned: 0 in 0.481s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-quobyte-f3d02ec6-b72f-4f70-b42e-402f9b42246d" released by "delete_volume" :: held 1.054s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Created reservations ['f234f486-170d-4c94-97a4-4184e5f71515', '5a7d905e-f77e-4ca7-9351-074f159ab2a2', '506d9156-62ee-4407-80fc-a42b72da9c6e', 'b68d5054-21fd-4dae-82ac-c1d70bcb59ab'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:06 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:06 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:06 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:06 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Deleted volume successfully. Apr 28 05:04:06 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6fa59715-c8b8-4cde-aabf-0e5fc546c4d6 tempest-VolumesSnapshotTestJSON-522987023 None] Lock "cinder-f3d02ec6-b72f-4f70-b42e-402f9b42246d-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Flow 'volume_create_manager' (8c7ccc44-c3a2-432a-bc4d-db7cb2771297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fc3bde-22a3-499a-aec4-58888c9e06f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fc3bde-22a3-499a-aec4-58888c9e06f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1851256057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128df447-02ba-4202-9ced-64c0299aae0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f2f0bee0c24c66bc611b4da2a9ef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:13Z,use_quota=True,user_id='cdfaa916805243ccbcd1bae8d1a8a8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5fb07c-c120-4c02-bbdc-842f2db0f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5fb07c-c120-4c02-bbdc-842f2db0f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0b3f0e-98d1-40af-b79c-bf228806f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0b3f0e-98d1-40af-b79c-bf228806f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128df447-02ba-4202-9ced-64c0299aae0f', 'volume_name': 'volume-128df447-02ba-4202-9ced-64c0299aae0f', 'volume_size': 2}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bdaff2-671c-4476-aeaa-b4828bb15827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bdaff2-671c-4476-aeaa-b4828bb15827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d735cbb9-f4f2-479d-b6be-d52b96d33b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:12 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Volume 128df447-02ba-4202-9ced-64c0299aae0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128df447-02ba-4202-9ced-64c0299aae0f', 'volume_size': 2} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1851256057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128df447-02ba-4202-9ced-64c0299aae0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f2f0bee0c24c66bc611b4da2a9ef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:13Z,use_quota=True,user_id='cdfaa916805243ccbcd1bae8d1a8a8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Creating volume 128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:12 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f 2147483648 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:12 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f 2147483648 Apr 28 05:04:12 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:13 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f 2147483648" returned: 0 in 0.631s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:13 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f Apr 28 05:04:13 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:13 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f" returned: 0 in 0.430s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d735cbb9-f4f2-479d-b6be-d52b96d33b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128df447-02ba-4202-9ced-64c0299aae0f', 'volume_size': 2}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4fdcee-759c-487b-83ff-b60d6d1b42b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:13 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Volume volume-128df447-02ba-4202-9ced-64c0299aae0f (128df447-02ba-4202-9ced-64c0299aae0f): created successfully Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4fdcee-759c-487b-83ff-b60d6d1b42b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:13 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Flow 'volume_create_manager' (8c7ccc44-c3a2-432a-bc4d-db7cb2771297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f03ae74b-23a3-4e70-a051-486f16b5ad6a tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Created volume successfully. Apr 28 05:04:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Creating offline snapshot cfc4db92-2791-4bb9-a296-6c1ef5c85083 of volume 128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:04:15 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8f108-3d0c-4f97-b538-4e99226ac1a3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:15 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f Apr 28 05:04:15 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:15 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 2G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:15 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 2G Apr 28 05:04:15 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:16 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 2G" returned: 0 in 0.573s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128df447-02ba-4202-9ced-64c0299aae0f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:16 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128df447-02ba-4202-9ced-64c0299aae0f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 Apr 28 05:04:16 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:16 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128df447-02ba-4202-9ced-64c0299aae0f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:16 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 is being set with open permissions: ugo+rw Apr 28 05:04:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:16 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 Apr 28 05:04:16 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:16 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083" returned: 0 in 0.421s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:17 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info Apr 28 05:04:17 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:17 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info" returned: 0 in 0.446s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:17 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info is being set with open permissions: ugo+rw Apr 28 05:04:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:17 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info Apr 28 05:04:17 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:17 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.info" returned: 0 in 0.431s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:17 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f447628c-f520-4f0d-9da9-9181b597180e tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Create snapshot completed successfully Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "cinder-cfc4db92-2791-4bb9-a296-6c1ef5c85083-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-cfc4db92-2791-4bb9-a296-6c1ef5c85083-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "cinder-quobyte-cfc4db92-2791-4bb9-a296-6c1ef5c85083" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-cfc4db92-2791-4bb9-a296-6c1ef5c85083" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Deleting offline snapshot cfc4db92-2791-4bb9-a296-6c1ef5c85083 of volume 128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] snapshot_file for this snap is: volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb894da-6e77-40d3-ae28-dcbfa60c75d8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:18 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 Apr 28 05:04:18 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:18 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083" returned: 0 in 0.502s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-128df447-02ba-4202-9ced-64c0299aae0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[043ab968-3f46-4fd0-a007-446f1593f3d5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:18 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f Apr 28 05:04:18 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:19 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:19 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 Apr 28 05:04:19 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:19 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:19 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083 Apr 28 05:04:19 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:20 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f.cfc4db92-2791-4bb9-a296-6c1ef5c85083" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-cfc4db92-2791-4bb9-a296-6c1ef5c85083" released by "_delete_snapshot" :: held 2.084s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" released by "delete_snapshot" :: held 2.111s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:20 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Created reservations ['b23a11b4-1ca3-404c-a2cc-5cdca6f07a4c', '5b75c4a5-388a-49bd-9274-177b95f544e5', 'b60ac84c-7b6f-44b7-ade6-fc40e649db6b', 'b943f984-ba34-4b79-b256-cc84f0c3dbd7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Delete snapshot completed successfully. Apr 28 05:04:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f0f180f-512b-424e-b9ef-ede1978d82be tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-cfc4db92-2791-4bb9-a296-6c1ef5c85083-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "cinder-128df447-02ba-4202-9ced-64c0299aae0f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-128df447-02ba-4202-9ced-64c0299aae0f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02df4d5-e108-43d8-b1b9-08d69b85b77a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:21 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f Apr 28 05:04:21 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:22 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f" returned: 0 in 0.520s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:22 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f Apr 28 05:04:22 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:22 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-128df447-02ba-4202-9ced-64c0299aae0f" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-quobyte-128df447-02ba-4202-9ced-64c0299aae0f" released by "delete_volume" :: held 1.024s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Created reservations ['65b24bef-e5cc-4842-8b9e-67278a1f5059', '199273e5-476f-440b-813b-6836fcba7409', '9d43aad0-0f98-436a-b4ea-83ac19ac869c', '333a5937-11d7-460e-8314-f1967768bf76'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:22 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:22 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:23 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.433s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:23 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:23 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Deleted volume successfully. Apr 28 05:04:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-5f93dd85-6b4f-4912-8648-74dd39463374 tempest-VolumesSnapshotNegativeTestJSON-680560705 None] Lock "cinder-128df447-02ba-4202-9ced-64c0299aae0f-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (267ee02d-a02a-4880-bef0-f0a5989a23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7366ac55-9de0-4c56-be9e-2be23b5aff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7366ac55-9de0-4c56-be9e-2be23b5aff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404853017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc31ecaf-9689-4d05-9079-6da16e1a03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:26Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586ee175-4feb-4991-8689-9e6d5199336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586ee175-4feb-4991-8689-9e6d5199336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f84cae-f768-42b0-8485-7284881561c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f84cae-f768-42b0-8485-7284881561c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc31ecaf-9689-4d05-9079-6da16e1a03c5', 'volume_name': 'volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341e3586-23fe-4ef8-93bc-1283e52a0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341e3586-23fe-4ef8-93bc-1283e52a0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba071bc8-40c6-478d-861f-e91286df4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:26 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume dc31ecaf-9689-4d05-9079-6da16e1a03c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5', 'volume_size': 1} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404853017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc31ecaf-9689-4d05-9079-6da16e1a03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:26Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume dc31ecaf-9689-4d05-9079-6da16e1a03c5 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:26 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:26 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 1073741824 Apr 28 05:04:26 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:26 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 1073741824" returned: 0 in 0.596s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:26 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 Apr 28 05:04:26 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:27 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5" returned: 0 in 0.447s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba071bc8-40c6-478d-861f-e91286df4f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1bfcc6-0389-4d33-8327-d4fd2f0dc63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 (dc31ecaf-9689-4d05-9079-6da16e1a03c5): created successfully Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1bfcc6-0389-4d33-8327-d4fd2f0dc63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (267ee02d-a02a-4880-bef0-f0a5989a23cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f8f10a3f-b0c1-477c-ac38-8d045b482bab tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (6fecc4b2-f251-40c0-906e-2849fad50ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e5af7-b50f-49d8-926a-964e746d5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e5af7-b50f-49d8-926a-964e746d5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78933577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34209b53-0316-4771-b70b-6112eca0c979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:28Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea60b0f-20b2-4d86-9712-799fe3a6e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea60b0f-20b2-4d86-9712-799fe3a6e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7838e81-a512-4cc0-9d9e-9dc1a95e6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7838e81-a512-4cc0-9d9e-9dc1a95e6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34209b53-0316-4771-b70b-6112eca0c979', 'volume_name': 'volume-34209b53-0316-4771-b70b-6112eca0c979', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab651d13-a492-4e79-8d28-d03231ef8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab651d13-a492-4e79-8d28-d03231ef8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17416f5f-7edc-49fc-93cf-f2b882fff953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume 34209b53-0316-4771-b70b-6112eca0c979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34209b53-0316-4771-b70b-6112eca0c979', 'volume_size': 1} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78933577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34209b53-0316-4771-b70b-6112eca0c979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:28Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume 34209b53-0316-4771-b70b-6112eca0c979 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:28 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:28 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 1073741824 Apr 28 05:04:28 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (42e0ef72-c5c3-4f0c-af0a-f5e09561eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22505262-2a68-453f-8019-abeb2df15c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22505262-2a68-453f-8019-abeb2df15c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82180781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eee412b-290a-44cb-8084-d5b5ee2c1925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837efe4c-4b8a-4e24-8e47-387749724946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837efe4c-4b8a-4e24-8e47-387749724946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b864b4cb-c1bb-459e-bf24-1cb63bd50b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b864b4cb-c1bb-459e-bf24-1cb63bd50b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eee412b-290a-44cb-8084-d5b5ee2c1925', 'volume_name': 'volume-1eee412b-290a-44cb-8084-d5b5ee2c1925', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8be0402-fb2c-49c3-902e-41af856fd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8be0402-fb2c-49c3-902e-41af856fd54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b9632c-a082-4a7a-a843-7ec9c8ee03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:28 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume 1eee412b-290a-44cb-8084-d5b5ee2c1925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eee412b-290a-44cb-8084-d5b5ee2c1925', 'volume_size': 1} Apr 28 05:04:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (99143a78-8519-4470-8474-44e78c681204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baec4e25-c44c-4ebc-9c4b-1b7847551e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baec4e25-c44c-4ebc-9c4b-1b7847551e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536853439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12bb024-aa86-4d83-84bb-1be5f9a0ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c13b36-0d2d-40d2-959e-9726ad5814c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c13b36-0d2d-40d2-959e-9726ad5814c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61405fd9-abca-474e-90d6-10b68f8490c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61405fd9-abca-474e-90d6-10b68f8490c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12bb024-aa86-4d83-84bb-1be5f9a0ed92', 'volume_name': 'volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea9d853-c94d-4449-bff9-7bd4630fd8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea9d853-c94d-4449-bff9-7bd4630fd8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b528d3-9faa-4c14-b3b0-fdf5e3aab37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume b12bb024-aa86-4d83-84bb-1be5f9a0ed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92', 'volume_size': 1} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:29 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 1073741824" returned: 0 in 0.654s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:29 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 Apr 28 05:04:29 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (966f263d-4ca8-4a91-b91e-dfe7e98280e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eae6c12-e216-440a-a32c-7f1a60dc2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eae6c12-e216-440a-a32c-7f1a60dc2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409606342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9c2ab4-93cb-4c0c-8308-bae19ca33962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31df0e13-66ca-42bc-91d9-ab29a7d4c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31df0e13-66ca-42bc-91d9-ab29a7d4c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80ce0a8-9c6a-418c-97e1-360faa5c5b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80ce0a8-9c6a-418c-97e1-360faa5c5b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9c2ab4-93cb-4c0c-8308-bae19ca33962', 'volume_name': 'volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d88716-9e58-4e91-9c67-b7713172737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d88716-9e58-4e91-9c67-b7713172737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec97f9-acee-4132-84dc-c9d9185f8f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume 3d9c2ab4-93cb-4c0c-8308-bae19ca33962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962', 'volume_size': 1} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (7271f0ef-52c1-4388-adc6-ea9f841630dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a665e-396e-4c64-a516-8114a8e3d7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a665e-396e-4c64-a516-8114a8e3d7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698590011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05b80de-7b18-4997-979b-4bc71d42e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2d546-74b7-4369-a8f8-6860b6d6a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2d546-74b7-4369-a8f8-6860b6d6a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d83ee75-6ab2-4604-a788-2bbac3ef849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d83ee75-6ab2-4604-a788-2bbac3ef849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05b80de-7b18-4997-979b-4bc71d42e7d1', 'volume_name': 'volume-a05b80de-7b18-4997-979b-4bc71d42e7d1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089b7140-24e3-44cf-a2a8-068ddbec3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089b7140-24e3-44cf-a2a8-068ddbec3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7118c7f-babb-4618-8ca4-3a879a1c4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume a05b80de-7b18-4997-979b-4bc71d42e7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05b80de-7b18-4997-979b-4bc71d42e7d1', 'volume_size': 1} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:29 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979" returned: 0 in 0.535s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82180781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eee412b-290a-44cb-8084-d5b5ee2c1925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume 1eee412b-290a-44cb-8084-d5b5ee2c1925 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17416f5f-7edc-49fc-93cf-f2b882fff953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34209b53-0316-4771-b70b-6112eca0c979', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111dab42-b772-4ee6-926a-6f085e354ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:29 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 1073741824 Apr 28 05:04:29 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-34209b53-0316-4771-b70b-6112eca0c979 (34209b53-0316-4771-b70b-6112eca0c979): created successfully Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111dab42-b772-4ee6-926a-6f085e354ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (6fecc4b2-f251-40c0-906e-2849fad50ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-93131d1a-27f0-4731-bc6a-cca0e4779ab7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:30 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 1073741824" returned: 0 in 0.614s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:30 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 Apr 28 05:04:30 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:30 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925" returned: 0 in 0.429s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536853439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12bb024-aa86-4d83-84bb-1be5f9a0ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume b12bb024-aa86-4d83-84bb-1be5f9a0ed92 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:30 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b9632c-a082-4a7a-a843-7ec9c8ee03aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eee412b-290a-44cb-8084-d5b5ee2c1925', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcea51d-e2f5-439d-a9cc-dc1ae53529e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:30 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 1073741824 Apr 28 05:04:30 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:30 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 (1eee412b-290a-44cb-8084-d5b5ee2c1925): created successfully Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcea51d-e2f5-439d-a9cc-dc1ae53529e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (42e0ef72-c5c3-4f0c-af0a-f5e09561eabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:30 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f1f8455e-277d-4a9d-a9ee-88b3d2cbacbd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:31 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 1073741824" returned: 0 in 0.602s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:31 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 Apr 28 05:04:31 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:31 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" returned: 0 in 0.429s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.539s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409606342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9c2ab4-93cb-4c0c-8308-bae19ca33962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume 3d9c2ab4-93cb-4c0c-8308-bae19ca33962 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:31 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:31 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 1073741824 Apr 28 05:04:31 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b528d3-9faa-4c14-b3b0-fdf5e3aab37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22261ab-fb65-4e70-820d-2560c0c44037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:31 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 (b12bb024-aa86-4d83-84bb-1be5f9a0ed92): created successfully Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22261ab-fb65-4e70-820d-2560c0c44037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (99143a78-8519-4470-8474-44e78c681204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-3b9f06b8-f1c9-409d-9141-a71d2756f618 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:32 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 1073741824" returned: 0 in 0.616s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:32 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 Apr 28 05:04:32 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:32 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.397s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698590011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05b80de-7b18-4997-979b-4bc71d42e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c241580bf90409bb63dfebaa00df770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:29Z,use_quota=True,user_id='4a023add32d14fd0942ce7164a72f787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Creating volume a05b80de-7b18-4997-979b-4bc71d42e7d1 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:32 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec97f9-acee-4132-84dc-c9d9185f8f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:33 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 1073741824 Apr 28 05:04:33 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87891757-b777-4458-9cf8-fab7fca6003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 (3d9c2ab4-93cb-4c0c-8308-bae19ca33962): created successfully Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87891757-b777-4458-9cf8-fab7fca6003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (966f263d-4ca8-4a91-b91e-dfe7e98280e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-fccfa8dc-0269-4234-9474-a7bf0ac38cfe tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:33 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 1073741824" returned: 0 in 0.615s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:33 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 Apr 28 05:04:33 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:34 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7118c7f-babb-4618-8ca4-3a879a1c4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05b80de-7b18-4997-979b-4bc71d42e7d1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d98c04-9a17-430e-8738-960d01b26175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:34 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Volume volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 (a05b80de-7b18-4997-979b-4bc71d42e7d1): created successfully Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d98c04-9a17-430e-8738-960d01b26175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Flow 'volume_create_manager' (7271f0ef-52c1-4388-adc6-ea9f841630dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-5130c71d-385f-459c-bd5d-f2782068ca9a tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created volume successfully. Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-a05b80de-7b18-4997-979b-4bc71d42e7d1-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-a05b80de-7b18-4997-979b-4bc71d42e7d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-a05b80de-7b18-4997-979b-4bc71d42e7d1" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-a05b80de-7b18-4997-979b-4bc71d42e7d1" acquired by "delete_volume" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8114fc-3819-41c4-87aa-878b92e0a8be]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:35 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 Apr 28 05:04:35 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:35 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:35 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1 Apr 28 05:04:35 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:36 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a05b80de-7b18-4997-979b-4bc71d42e7d1" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-a05b80de-7b18-4997-979b-4bc71d42e7d1" released by "delete_volume" :: held 1.010s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['b1a72b21-e28e-455e-b098-0e14fb4a2d5e', 'ff46ed7c-32e8-417d-afd3-30de37e3463d', '90fdfee8-6301-4bd5-bfcc-cbf42c61c168', '81a1738f-8a30-4569-ab39-b51342b7f6ae'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:36 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:36 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:36 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.444s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a8ff2274-4c2c-4c3f-9346-02454ceaccc7 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-a05b80de-7b18-4997-979b-4bc71d42e7d1-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-3d9c2ab4-93cb-4c0c-8308-bae19ca33962-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-3d9c2ab4-93cb-4c0c-8308-bae19ca33962-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ca3d2-9516-4a87-8d18-37b32fa844a9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:37 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 Apr 28 05:04:37 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:37 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" returned: 0 in 0.515s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:37 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962 Apr 28 05:04:37 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:38 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" returned: 0 in 0.457s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-3d9c2ab4-93cb-4c0c-8308-bae19ca33962" released by "delete_volume" :: held 1.014s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['7cdee557-ca14-40f0-8900-760bba458402', '481ae98f-5a7a-4079-a2c7-9a06cfc79a49', 'fcb3fbbb-d2b6-4c0c-b7d1-66faca26f6f7', 'd3f541c3-cea7-41ed-b281-3b2c02f8ead6'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:38 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:38 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:38 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.421s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cbaabc24-d795-47d1-acb8-05e783724948 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-3d9c2ab4-93cb-4c0c-8308-bae19ca33962-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-b12bb024-aa86-4d83-84bb-1be5f9a0ed92-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-b12bb024-aa86-4d83-84bb-1be5f9a0ed92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=75,cinder:INSERT=26,cinder:UPDATE=105,cinder:DELETE=9 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2061183b-9d2f-44b4-ae0b-76bc1099f923]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:39 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 Apr 28 05:04:39 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:40 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" returned: 0 in 0.498s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:40 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92 Apr 28 05:04:40 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:40 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-b12bb024-aa86-4d83-84bb-1be5f9a0ed92" released by "delete_volume" :: held 0.979s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['445fb1eb-a126-4ebb-85a4-92b444265d48', 'bac0e504-ea80-481f-b960-0552f8feeb84', 'ecc74877-a5cc-4f93-a5ca-bd0e427e0c5e', '1ffa8fd1-f30f-43c2-8b81-9354003a24e4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:40 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:40 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:41 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.425s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-897fc556-5225-497a-8f72-6b96ba9aa4fd tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-b12bb024-aa86-4d83-84bb-1be5f9a0ed92-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-1eee412b-290a-44cb-8084-d5b5ee2c1925-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-1eee412b-290a-44cb-8084-d5b5ee2c1925-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-1eee412b-290a-44cb-8084-d5b5ee2c1925" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-1eee412b-290a-44cb-8084-d5b5ee2c1925" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d162e8-eaba-4e39-8941-0ae37ab51ae7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:41 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 Apr 28 05:04:41 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:42 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925" returned: 0 in 0.536s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:42 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925 Apr 28 05:04:42 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:42 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1eee412b-290a-44cb-8084-d5b5ee2c1925" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-1eee412b-290a-44cb-8084-d5b5ee2c1925" released by "delete_volume" :: held 1.037s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['21da2a0f-92b7-4d5a-909e-54f508fbdb88', '11c68847-bf5b-4ac1-8485-130610f0c72c', 'ed75fbe7-e789-4bec-897f-b4cfad769e44', '5d7aaf22-20ea-4728-969e-5b2e3168055e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:42 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:42 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:43 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.461s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a3d8acbc-20d5-4e4e-bd36-a0264e403243 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-1eee412b-290a-44cb-8084-d5b5ee2c1925-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-34209b53-0316-4771-b70b-6112eca0c979-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-34209b53-0316-4771-b70b-6112eca0c979-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-34209b53-0316-4771-b70b-6112eca0c979" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-34209b53-0316-4771-b70b-6112eca0c979" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:44 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff1432-f5fb-4f2f-8f29-ed9549da7275]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:44 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 Apr 28 05:04:44 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:44 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979" returned: 0 in 0.533s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:44 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979 Apr 28 05:04:44 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:45 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-34209b53-0316-4771-b70b-6112eca0c979" returned: 0 in 0.451s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-34209b53-0316-4771-b70b-6112eca0c979" released by "delete_volume" :: held 1.027s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['d647978d-d2bd-45ad-afcb-cffeb3817b19', 'c984aeb7-e99c-4023-8ac5-9b16939d286f', '4b25b64a-7449-4df0-aee2-1d86d0798ea6', 'bf762cfc-0299-475a-8ee6-892c9a51b5e3'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:45 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:45 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:45 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.429s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8d48f327-bb47-4ea0-be5a-2c826dc787c9 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-34209b53-0316-4771-b70b-6112eca0c979-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-dc31ecaf-9689-4d05-9079-6da16e1a03c5-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-dc31ecaf-9689-4d05-9079-6da16e1a03c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "cinder-quobyte-dc31ecaf-9689-4d05-9079-6da16e1a03c5" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-dc31ecaf-9689-4d05-9079-6da16e1a03c5" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d71c58-e8a9-4fdf-b543-b7d74991cc47]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:46 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 Apr 28 05:04:46 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:46 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5" returned: 0 in 0.520s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:46 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5 Apr 28 05:04:46 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:47 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-dc31ecaf-9689-4d05-9079-6da16e1a03c5" returned: 0 in 0.427s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-quobyte-dc31ecaf-9689-4d05-9079-6da16e1a03c5" released by "delete_volume" :: held 0.994s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Created reservations ['1188f377-6e39-4797-8a51-f92a7a3e9169', '41702967-579a-4324-bdc1-0ad189e89771', '09ea82e8-a533-417a-891d-727f8517284e', '3636cd08-418e-4791-8e0d-726d8223c6d4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:47 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:47 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:47 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.420s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Deleted volume successfully. Apr 28 05:04:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-cabd1434-7670-44e2-b2df-2e372dbdb615 tempest-CreateVolumesFromSourceVolumeTest-96782414 None] Lock "cinder-dc31ecaf-9689-4d05-9079-6da16e1a03c5-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:56 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:04:56 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=91,cinder:DELETE=9,cinder:UPDATE=118,cinder:INSERT=28 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:04:56 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (22c01723-4bc2-4a80-a1cb-983922bb11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58befc9-2722-4d8f-921e-1e2867271353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58befc9-2722-4d8f-921e-1e2867271353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-228266731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1eed1cc-9a60-4022-be15-a7b198bd3403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28179011-387a-4657-ae6f-01dfbfaf15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28179011-387a-4657-ae6f-01dfbfaf15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0e5e43-ca05-4806-ac21-0d50af2dd173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0e5e43-ca05-4806-ac21-0d50af2dd173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1eed1cc-9a60-4022-be15-a7b198bd3403', 'volume_name': 'volume-e1eed1cc-9a60-4022-be15-a7b198bd3403', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31e0f87-d829-45ea-84fd-4199613a6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31e0f87-d829-45ea-84fd-4199613a6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf8bb4-6cb4-4aab-83f8-c5321e7f607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Volume e1eed1cc-9a60-4022-be15-a7b198bd3403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1eed1cc-9a60-4022-be15-a7b198bd3403', 'volume_size': 1} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-228266731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1eed1cc-9a60-4022-be15-a7b198bd3403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Creating volume e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:57 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 1073741824 Apr 28 05:04:57 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (1565c630-721f-4e9c-9846-54da7a10e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a953afab-db28-406a-b2fe-0d8a32d4b4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a953afab-db28-406a-b2fe-0d8a32d4b4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1265017856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d86d39-49e7-463a-ac41-96bc5b2a8d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d3219-0c7a-4582-8af5-c58cb427858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d3219-0c7a-4582-8af5-c58cb427858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a3a5a6-48a4-472d-a685-9ed92a296a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a3a5a6-48a4-472d-a685-9ed92a296a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d86d39-49e7-463a-ac41-96bc5b2a8d93', 'volume_name': 'volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a8c48-c2d5-4102-8452-af5c6f328695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a8c48-c2d5-4102-8452-af5c6f328695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0e03b-dee9-49db-9d81-10ff5ee56645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Volume f3d86d39-49e7-463a-ac41-96bc5b2a8d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93', 'volume_size': 1} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:57 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.924s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (b97c1509-0f35-4b06-911c-3a5c30351c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b166a51-4b83-48ca-b103-46b39dc7b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b166a51-4b83-48ca-b103-46b39dc7b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-997248813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e842fc-7264-43b3-84b7-389017a1f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f796347-d64a-434b-86c4-2a6d592bf08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f796347-d64a-434b-86c4-2a6d592bf08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf95f7-3342-4a85-aa43-8b302ed5d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf95f7-3342-4a85-aa43-8b302ed5d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e842fc-7264-43b3-84b7-389017a1f76e', 'volume_name': 'volume-f6e842fc-7264-43b3-84b7-389017a1f76e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26c1d1e-3cd9-4b8b-a46c-bb7d4f7ffc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26c1d1e-3cd9-4b8b-a46c-bb7d4f7ffc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad2d82-3eca-4cca-8331-cd9e86a06342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume f6e842fc-7264-43b3-84b7-389017a1f76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e842fc-7264-43b3-84b7-389017a1f76e', 'volume_size': 1} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (632ee221-589b-43e1-ac15-9931732d50a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4bdd91-6aa3-49b4-9f7a-a4e399bc6905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4bdd91-6aa3-49b4-9f7a-a4e399bc6905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138875944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a9f08-f005-492b-9088-3bfb11d6a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a9f08-f005-492b-9088-3bfb11d6a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c2253f-4919-4ae2-b4fb-223241fe0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c2253f-4919-4ae2-b4fb-223241fe0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed', 'volume_name': 'volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357281a6-2c73-42d4-83be-5cf87c26454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357281a6-2c73-42d4-83be-5cf87c26454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19183d63-78e7-4263-8986-670dfef22ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Volume 1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed', 'volume_size': 1} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (064f8087-27db-421e-993e-847ceffb38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11f4a1c-c6af-4172-9f25-5568f238886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11f4a1c-c6af-4172-9f25-5568f238886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649884831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44cfff6-596a-46e7-90b9-5a6215c97e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb843bc-637a-4087-a227-05f830be17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb843bc-637a-4087-a227-05f830be17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2fbdaa-9d9e-4188-a021-4e2e09635fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2fbdaa-9d9e-4188-a021-4e2e09635fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44cfff6-596a-46e7-90b9-5a6215c97e93', 'volume_name': 'volume-f44cfff6-596a-46e7-90b9-5a6215c97e93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfcfe5d-d181-43d8-a748-6e0e155bd5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfcfe5d-d181-43d8-a748-6e0e155bd5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15613e6-7105-44a9-ba3c-2d7f1ba2a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:57 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Volume f44cfff6-596a-46e7-90b9-5a6215c97e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44cfff6-596a-46e7-90b9-5a6215c97e93', 'volume_size': 1} Apr 28 05:04:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (8ca63950-212e-4633-ad9e-1add0fc26b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c778c0f-a5ad-421d-b1fd-b3e3304835ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c778c0f-a5ad-421d-b1fd-b3e3304835ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1845037111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33803b8-db88-4483-bd57-29fc2caecf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfce232-3b96-4736-9fd1-9aa88339b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfce232-3b96-4736-9fd1-9aa88339b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec4915-c9bf-40bb-a66b-c9bfd7461493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec4915-c9bf-40bb-a66b-c9bfd7461493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33803b8-db88-4483-bd57-29fc2caecf22', 'volume_name': 'volume-a33803b8-db88-4483-bd57-29fc2caecf22', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9efd20f-6f26-41db-9506-f93f6dfe4a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9efd20f-6f26-41db-9506-f93f6dfe4a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0892c8e-7534-4581-9f1a-6981599e26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Volume a33803b8-db88-4483-bd57-29fc2caecf22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33803b8-db88-4483-bd57-29fc2caecf22', 'volume_size': 1} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:58 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 1073741824" returned: 0 in 1.052s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:58 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:04:58 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (d96cb567-cdd6-4cc0-a959-9db82aa4fadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d6a88d-5d7c-4031-9af2-dbcc5b87d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d6a88d-5d7c-4031-9af2-dbcc5b87d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983933055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb906b6e-9ca0-4f77-92a3-11e2c3287789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c83f2b-dadc-4b79-bc02-f68aaafa1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c83f2b-dadc-4b79-bc02-f68aaafa1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777ae3ac-fbf0-4d8f-9f9e-a4275d7cf473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777ae3ac-fbf0-4d8f-9f9e-a4275d7cf473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb906b6e-9ca0-4f77-92a3-11e2c3287789', 'volume_name': 'volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d646d4-7946-4888-8aee-bc6a11b25376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d646d4-7946-4888-8aee-bc6a11b25376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378465f-ea9f-4659-b894-89d7cc87ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Volume cb906b6e-9ca0-4f77-92a3-11e2c3287789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789', 'volume_size': 1} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:58 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.497s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1265017856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d86d39-49e7-463a-ac41-96bc5b2a8d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Creating volume f3d86d39-49e7-463a-ac41-96bc5b2a8d93 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:04:58 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:58 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 1073741824 Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf8bb4-6cb4-4aab-83f8-c5321e7f607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1eed1cc-9a60-4022-be15-a7b198bd3403', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aba687c-0abb-41d0-94ea-c22d58d9767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:04:58 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Volume volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 (e1eed1cc-9a60-4022-be15-a7b198bd3403): created successfully Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aba687c-0abb-41d0-94ea-c22d58d9767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:04:58 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (22c01723-4bc2-4a80-a1cb-983922bb11ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:04:58 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-171c18ff-9043-4256-82a0-863dd4f8e23e tempest-VolumeDependencyTests-1235887502 None] Created volume successfully. Apr 28 05:04:59 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 28 05:04:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 1073741824" returned: 0 in 0.751s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:04:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:04:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:04:59 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 Apr 28 05:04:59 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:00 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" returned: 0 in 0.499s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-997248813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e842fc-7264-43b3-84b7-389017a1f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:00 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0e03b-dee9-49db-9d81-10ff5ee56645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4149ada3-1a1a-41b6-9468-42e1776215be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:00 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e 1073741824 Apr 28 05:05:00 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:00 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Volume volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 (f3d86d39-49e7-463a-ac41-96bc5b2a8d93): created successfully Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4149ada3-1a1a-41b6-9468-42e1776215be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (1565c630-721f-4e9c-9846-54da7a10e31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-55586507-35dd-49e2-8f4c-f213f6427197 tempest-CreateVolumesFromImageTest-1511330926 None] Created volume successfully. Apr 28 05:05:00 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e 1073741824" returned: 0 in 0.685s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:00 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e Apr 28 05:05:00 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:01 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.618s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138875944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:57Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Creating volume 1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:01 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad2d82-3eca-4cca-8331-cd9e86a06342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e842fc-7264-43b3-84b7-389017a1f76e', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f84d3-b0bb-4589-8305-6ec316b47ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:01 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-f6e842fc-7264-43b3-84b7-389017a1f76e (f6e842fc-7264-43b3-84b7-389017a1f76e): created successfully Apr 28 05:05:01 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed 1073741824 Apr 28 05:05:01 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f84d3-b0bb-4589-8305-6ec316b47ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (b97c1509-0f35-4b06-911c-3a5c30351c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:01 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ecf564d4-b5d3-4d54-858d-d91197416ee7 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:01 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:02 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed 1073741824" returned: 0 in 0.782s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:02 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed Apr 28 05:05:02 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:02 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" returned: 0 in 0.444s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.806s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649884831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44cfff6-596a-46e7-90b9-5a6215c97e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Creating volume f44cfff6-596a-46e7-90b9-5a6215c97e93 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:02 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19183d63-78e7-4263-8986-670dfef22ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:02 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 1073741824 Apr 28 05:05:02 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28b8e5-ccc3-4efa-a2be-a46523f6a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:02 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Volume volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed (1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed): created successfully Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28b8e5-ccc3-4efa-a2be-a46523f6a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:02 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (632ee221-589b-43e1-ac15-9931732d50a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:02 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f33a667c-f351-48bc-85e7-bdd8c6f2c145 tempest-CreateVolumesFromImageTest-1511330926 None] Created volume successfully. Apr 28 05:05:03 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 1073741824" returned: 0 in 0.707s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:03 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 Apr 28 05:05:03 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:04 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93" returned: 0 in 0.551s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.810s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1845037111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33803b8-db88-4483-bd57-29fc2caecf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Creating volume a33803b8-db88-4483-bd57-29fc2caecf22 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:04 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:04 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 1073741824 Apr 28 05:05:04 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15613e6-7105-44a9-ba3c-2d7f1ba2a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44cfff6-596a-46e7-90b9-5a6215c97e93', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1127ba41-6809-428c-9a1c-a893660b0ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:04 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Volume volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 (f44cfff6-596a-46e7-90b9-5a6215c97e93): created successfully Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1127ba41-6809-428c-9a1c-a893660b0ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (064f8087-27db-421e-993e-847ceffb38e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9d2f896c-2ffe-4151-8fed-f31ea0070644 tempest-CreateVolumesFromImageTest-1511330926 None] Created volume successfully. Apr 28 05:05:04 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 1073741824" returned: 0 in 0.695s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:04 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 Apr 28 05:05:04 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:05 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22" returned: 0 in 0.503s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.783s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983933055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb906b6e-9ca0-4f77-92a3-11e2c3287789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a8a7f8ba82442083eb92d21800bd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:04:58Z,use_quota=True,user_id='b182874a4f8e41df9a347628df604919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Creating volume cb906b6e-9ca0-4f77-92a3-11e2c3287789 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:05 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0892c8e-7534-4581-9f1a-6981599e26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33803b8-db88-4483-bd57-29fc2caecf22', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a1726c-1549-441d-993e-1bd0ee5ecb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:05 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 1073741824 Apr 28 05:05:05 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:05 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Volume volume-a33803b8-db88-4483-bd57-29fc2caecf22 (a33803b8-db88-4483-bd57-29fc2caecf22): created successfully Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a1726c-1549-441d-993e-1bd0ee5ecb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (8ca63950-212e-4633-ad9e-1add0fc26b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-329a332f-c4f5-459c-9b5e-81e9c6e5d4c0 tempest-CreateVolumesFromImageTest-1511330926 None] Created volume successfully. Apr 28 05:05:05 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 1073741824" returned: 0 in 0.691s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:06 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 Apr 28 05:05:06 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:06 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789" returned: 0 in 0.471s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.840s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378465f-ea9f-4659-b894-89d7cc87ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82501552-2e1f-4829-b3f3-13c9ff680940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Creating offline snapshot 2616b6f7-f356-4270-a11e-d21356bbeb96 of volume e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:05:06 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Volume volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 (cb906b6e-9ca0-4f77-92a3-11e2c3287789): created successfully Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82501552-2e1f-4829-b3f3-13c9ff680940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Flow 'volume_create_manager' (d96cb567-cdd6-4cc0-a959-9db82aa4fadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91ef2a-b8ae-464d-bd5c-47f5b7ab0af9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:06 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f97f6453-ea5c-4517-8273-ec6fa11daae4 tempest-CreateVolumesFromImageTest-1511330926 None] Created volume successfully. Apr 28 05:05:06 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:06 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:07 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.568s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:07 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 1G Apr 28 05:05:07 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-cb906b6e-9ca0-4f77-92a3-11e2c3287789-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-cb906b6e-9ca0-4f77-92a3-11e2c3287789-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-quobyte-cb906b6e-9ca0-4f77-92a3-11e2c3287789" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-cb906b6e-9ca0-4f77-92a3-11e2c3287789" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c5e65-6b19-40e5-b566-9bea5241be8e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:07 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 Apr 28 05:05:07 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:07 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 1G" returned: 0 in 0.741s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:07 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:07 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:08 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789" returned: 0 in 0.679s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:08 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789 Apr 28 05:05:08 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:08 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 0.573s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:08 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 is being set with open permissions: ugo+rw Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:08 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:08 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:08 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-cb906b6e-9ca0-4f77-92a3-11e2c3287789" returned: 0 in 0.629s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-cb906b6e-9ca0-4f77-92a3-11e2c3287789" released by "delete_volume" :: held 1.355s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Created reservations ['e72d1d44-11e6-4427-b0bf-0e7b7114c5f6', '79fb1b65-94bf-4739-9491-ef970c4c0e8b', 'd4267fb0-5748-4e45-aef5-d04290b28270', '51dda323-730f-4913-a891-17d9d58434e4'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:08 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:08 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:08 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:09 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info Apr 28 05:05:09 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:09 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.517s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:09 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Deleted volume successfully. Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-da8cb679-b472-4fdb-8867-f70a527f563b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-cb906b6e-9ca0-4f77-92a3-11e2c3287789-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:09 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-a33803b8-db88-4483-bd57-29fc2caecf22-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:09 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info is being set with open permissions: ugo+rw Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-a33803b8-db88-4483-bd57-29fc2caecf22-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:09 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info Apr 28 05:05:09 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-quobyte-a33803b8-db88-4483-bd57-29fc2caecf22" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-a33803b8-db88-4483-bd57-29fc2caecf22" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ef152-d67f-4c5f-8bf2-4cb30079c1f7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:09 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 Apr 28 05:05:09 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:10 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.info" returned: 0 in 0.527s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.638s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.194s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating offline snapshot cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 of volume f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:05:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-24d3d7db-d37c-4728-bab6-96a26ed7096d tempest-VolumeDependencyTests-1235887502 None] Create snapshot completed successfully Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aa62ec-3b0f-45c6-b2f7-fcb10d5c88b7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:10 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e Apr 28 05:05:10 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:10 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22" returned: 0 in 0.634s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:10 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22 Apr 28 05:05:10 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:10 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e" returned: 0 in 0.677s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:10 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 1G Apr 28 05:05:10 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:10 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a33803b8-db88-4483-bd57-29fc2caecf22" returned: 0 in 0.561s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-a33803b8-db88-4483-bd57-29fc2caecf22" released by "delete_volume" :: held 1.252s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:10 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Created reservations ['e58d8e5b-37a2-40e9-9944-454bfb9cbd46', '05cfddab-f428-4d3a-8cd5-a66636c2ec76', '0f615526-ff21-429b-a6c3-ba18e758a9b6', 'b7b55b66-f561-4a21-9595-4425044c2ebc'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:11 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:11 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:11 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 1G" returned: 0 in 0.834s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e842fc-7264-43b3-84b7-389017a1f76e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:11 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e842fc-7264-43b3-84b7-389017a1f76e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 Apr 28 05:05:11 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:11 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.685s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:11 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Deleted volume successfully. Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-f44cfff6-596a-46e7-90b9-5a6215c97e93-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (918cf192-03a9-4379-bbe1-6ad4773cb67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d998b0e5-c1d8-4b07-befb-eaf1841f735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c18ba1d6-7243-4659-bd66-53e619c3196b tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-a33803b8-db88-4483-bd57-29fc2caecf22-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-f44cfff6-596a-46e7-90b9-5a6215c97e93-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d998b0e5-c1d8-4b07-befb-eaf1841f735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468228324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb87c96-b57d-40d3-9ffe-730fa3f17713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2616b6f7-f356-4270-a11e-d21356bbeb96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:12Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0156dc53-ef0c-4837-a9ba-0b0275bb7188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0156dc53-ef0c-4837-a9ba-0b0275bb7188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2abb17-c1b2-4165-a326-56e2116de951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2abb17-c1b2-4165-a326-56e2116de951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cb87c96-b57d-40d3-9ffe-730fa3f17713', 'volume_name': 'volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713', 'volume_size': 1, 'snapshot_id': '2616b6f7-f356-4270-a11e-d21356bbeb96'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7025544-3cb7-4f22-8de3-51751f94507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7025544-3cb7-4f22-8de3-51751f94507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c89440a-21f5-45ca-bcc7-2bb9a22df69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:11 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Volume 5cb87c96-b57d-40d3-9ffe-730fa3f17713: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713', 'volume_size': 1, 'snapshot_id': '2616b6f7-f356-4270-a11e-d21356bbeb96'} Apr 28 05:05:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-quobyte-f44cfff6-596a-46e7-90b9-5a6215c97e93" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-f44cfff6-596a-46e7-90b9-5a6215c97e93" acquired by "delete_volume" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b6a74-95d7-4b30-b53f-e8aea0f4e8f2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:12 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 Apr 28 05:05:12 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:12 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e842fc-7264-43b3-84b7-389017a1f76e -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" returned: 0 in 0.742s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:12 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 is being set with open permissions: ugo+rw Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:12 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 Apr 28 05:05:12 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:12 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93" returned: 0 in 0.667s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:12 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93 Apr 28 05:05:12 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:12 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" returned: 0 in 0.492s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:13 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info Apr 28 05:05:13 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:13 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f44cfff6-596a-46e7-90b9-5a6215c97e93" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-f44cfff6-596a-46e7-90b9-5a6215c97e93" released by "delete_volume" :: held 1.202s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Created reservations ['953a8ba6-e285-4168-835e-a506be2eb7fc', '1e6d837b-ff3c-4127-8c40-0ab4f3a976f0', 'e25679b7-ad6f-435a-9f06-1b4d55002ae8', '47e6dbbe-f869-46c9-b658-6e6040ad22d1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:13 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:13 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:13 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info" returned: 0 in 0.612s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:13 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info is being set with open permissions: ugo+rw Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:13 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info Apr 28 05:05:13 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:13 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.561s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:13 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:13 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Deleted volume successfully. Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-92612b9a-4e35-47c2-8b8e-3675d3fb3dd0 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-f44cfff6-596a-46e7-90b9-5a6215c97e93-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:14 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.info" returned: 0 in 0.551s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.024s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.170s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96-5cb87c96-b57d-40d3-9ffe-730fa3f17713" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96-5cb87c96-b57d-40d3-9ffe-730fa3f17713" acquired by "_create_volume_from_snapshot" :: waited 0.087s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Creating volume 5cb87c96-b57d-40d3-9ffe-730fa3f17713 from snapshot 2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] snapshot: 2616b6f7-f356-4270-a11e-d21356bbeb96, volume: 5cb87c96-b57d-40d3-9ffe-730fa3f17713, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:05:14 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c9b803a4-2ebc-405f-8656-22007da6a4ae tempest-CreateVolumesFromSnapshotTest-745633016 None] Create snapshot completed successfully Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d8d6e-f71b-4f41-9b18-59f82646bddd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-quobyte-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" acquired by "delete_volume" :: waited 0.040s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f39de1-0cc1-412d-a57a-db02cf61cd1f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:14 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:14 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:14 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed Apr 28 05:05:14 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:14 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (4886af32-bdcb-4c5e-a689-c0fd25738f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fd1255-cd2f-4cd2-9da1-971df22ec714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fd1255-cd2f-4cd2-9da1-971df22ec714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291275577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee8113a-c4d7-4253-a454-577d68339064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:15Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace11e4c-634f-4571-a996-9a50854c9140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace11e4c-634f-4571-a996-9a50854c9140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37eec2b-b56c-44f8-aded-cfbbffd28aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37eec2b-b56c-44f8-aded-cfbbffd28aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee8113a-c4d7-4253-a454-577d68339064', 'volume_name': 'volume-fee8113a-c4d7-4253-a454-577d68339064', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b0737e-17f0-462c-ac1c-4be7eef71091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b0737e-17f0-462c-ac1c-4be7eef71091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c230d1-b0af-4861-b938-6e76b289ceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume fee8113a-c4d7-4253-a454-577d68339064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee8113a-c4d7-4253-a454-577d68339064', 'volume_size': 1} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:15 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (496bdb13-b742-40d3-b368-acfeecc8bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:15 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d37b35-ad74-4d2c-9fa5-ebf9ad080f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" returned: 0 in 0.979s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 1.076s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1eed1cc-9a60-4022-be15-a7b198bd3403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:05:15 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed Apr 28 05:05:15 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d37b35-ad74-4d2c-9fa5-ebf9ad080f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1817918183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbb239-28a2-4b56-8414-c2908c94d13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:15Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56cca6f-4283-4061-9f93-54888c6e2037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56cca6f-4283-4061-9f93-54888c6e2037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6136421-e94f-4932-a8ce-02749bda16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6136421-e94f-4932-a8ce-02749bda16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cbb239-28a2-4b56-8414-c2908c94d13d', 'volume_name': 'volume-05cbb239-28a2-4b56-8414-c2908c94d13d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4421d3-b428-4d76-815a-bbee50d066d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4421d3-b428-4d76-815a-bbee50d066d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac610a9a-f668-4977-9c0f-be516e0e7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume 05cbb239-28a2-4b56-8414-c2908c94d13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cbb239-28a2-4b56-8414-c2908c94d13d', 'volume_size': 1} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a00d9-89b2-4ac2-92bf-599810fdc7a5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:15 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:15 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (a52ca777-2217-432d-8527-57f7041f7cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03facd9e-4b10-4537-b570-f8b3d0181b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:15 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03facd9e-4b10-4537-b570-f8b3d0181b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490787075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43b81a0-7345-4ec0-9add-3eea3374f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:16Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583ac554-186b-49e7-818a-0fd7912f7bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583ac554-186b-49e7-818a-0fd7912f7bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886682f7-2d8e-4ad3-a08d-0a20205d7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886682f7-2d8e-4ad3-a08d-0a20205d7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43b81a0-7345-4ec0-9add-3eea3374f785', 'volume_name': 'volume-a43b81a0-7345-4ec0-9add-3eea3374f785', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c28e8-5cfc-45cf-9608-923c8afad7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c28e8-5cfc-45cf-9608-923c8afad7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa05235-71ad-442a-9d5a-ebd68bb5f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume a43b81a0-7345-4ec0-9add-3eea3374f785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43b81a0-7345-4ec0-9add-3eea3374f785', 'volume_size': 1} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (8d1094f3-a757-4082-af89-bf5c64fbf205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d2faa0-617a-4c38-932f-8c98309cd6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d2faa0-617a-4c38-932f-8c98309cd6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182757144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb12bd2-8689-4d54-8f7a-83081af9c7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:16Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62977bf-b67a-4734-9554-fdfe5ead5558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62977bf-b67a-4734-9554-fdfe5ead5558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb6dd99-ff3c-4545-97c9-3c76b4f25730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb6dd99-ff3c-4545-97c9-3c76b4f25730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb12bd2-8689-4d54-8f7a-83081af9c7fe', 'volume_name': 'volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6708e29-94ca-434d-b7bd-29744ed317fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6708e29-94ca-434d-b7bd-29744ed317fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a54001-5434-4285-96c2-af796c9d62eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume 4fb12bd2-8689-4d54-8f7a-83081af9c7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe', 'volume_size': 1} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:16 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" returned: 0 in 0.968s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed" released by "delete_volume" :: held 2.015s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Created reservations ['de2abd19-1925-4543-a5e2-efcace610c2c', 'd513d34d-178d-42da-b0c3-fcf7ba1cf404', '3eec648c-3c96-462d-9fdd-124e916cda02', '805299a7-ced5-4d70-bd49-3776d6bc38be'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (03309eb5-9155-4e5c-9404-eedeb92e095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a7073-f678-4b9a-9cda-ebbfe0e45219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:16 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a7073-f678-4b9a-9cda-ebbfe0e45219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156433496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17329e7-32eb-4fd8-a459-d62494e153c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:17Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:16 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd80807-5a17-49f7-8bc9-5e828404f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd80807-5a17-49f7-8bc9-5e828404f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc635ca0-194e-47b1-9a99-ad8daa6fbdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc635ca0-194e-47b1-9a99-ad8daa6fbdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17329e7-32eb-4fd8-a459-d62494e153c6', 'volume_name': 'volume-e17329e7-32eb-4fd8-a459-d62494e153c6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ba236-ea5d-4990-8007-e57cbab404ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ba236-ea5d-4990-8007-e57cbab404ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163095a9-e245-4211-9e4b-a7fac27b01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:16 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume e17329e7-32eb-4fd8-a459-d62494e153c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17329e7-32eb-4fd8-a459-d62494e153c6', 'volume_size': 1} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 1.175s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:05:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:16 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 Apr 28 05:05:16 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:17 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.564s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:17 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Deleted volume successfully. Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a82a3539-57d1-444d-b2f1-8d0bdd6a1eb7 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-1aba2f20-a9ca-4d9a-ad8f-0ae6eb1035ed-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-f3d86d39-49e7-463a-ac41-96bc5b2a8d93-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Flow 'volume_create_manager' (9c7bedf4-e7ca-4096-ad30-641b700ea4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8287ca8f-91b3-4d2f-8d4f-57108dd15826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-f3d86d39-49e7-463a-ac41-96bc5b2a8d93-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "cinder-quobyte-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:17 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8287ca8f-91b3-4d2f-8d4f-57108dd15826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1287494344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fe16f7-e5c8-4115-92ab-1a8184259a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1140fbe8d542c0a54c6f829e809a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:18Z,use_quota=True,user_id='fec9c1ab9c8c43529e4ac29c6ece7d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2774de-714a-41ed-b5bf-93e389926f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2774de-714a-41ed-b5bf-93e389926f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1fdea-bf34-4c36-b820-b0d1d068d73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1fdea-bf34-4c36-b820-b0d1d068d73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fe16f7-e5c8-4115-92ab-1a8184259a0d', 'volume_name': 'volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d30663e-db65-4acb-86e2-3d669ea42d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d30663e-db65-4acb-86e2-3d669ea42d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb18457-7cbc-4cc2-8738-308ec294e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:18 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Volume 71fe16f7-e5c8-4115-92ab-1a8184259a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d', 'volume_size': 1} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" acquired by "delete_volume" :: waited 0.133s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[893e80bf-0aff-4eb8-ae1f-ccfaf8d65924]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:18 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 Apr 28 05:05:18 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:19 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" returned: 0 in 1.317s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:19 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93 Apr 28 05:05:19 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:20 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" returned: 0 in 0.760s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-quobyte-f3d86d39-49e7-463a-ac41-96bc5b2a8d93" released by "delete_volume" :: held 2.169s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Created reservations ['76fccb32-aa61-46d6-a695-35f1ea0e20df', 'e71d8711-c9b5-4e24-886f-63cbd8c956e4', '24fc218c-8f9a-4ab5-af36-4b8a6f6d113e', 'c616bc14-ded8-476b-b177-c34f8f350791'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:20 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:20 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:21 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:21 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.998s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:21 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:21 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Deleted volume successfully. Apr 28 05:05:21 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-715691a1-5550-4c07-b85e-edee6ae8ed00 tempest-CreateVolumesFromImageTest-1511330926 None] Lock "cinder-f3d86d39-49e7-463a-ac41-96bc5b2a8d93-delete_volume" released by "delete_volume" :: held 3.691s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:22 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713" returned: 0 in 5.368s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e9287-ca2e-4b38-91bd-24e62030b8c3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:22 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:22 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:22 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.742s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:05:22 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Converted 1024.00 MB image at 190.74 MB/s Apr 28 05:05:22 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 is being set with open permissions: ugo+rw Apr 28 05:05:22 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:22 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 Apr 28 05:05:22 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:23 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" released by "_copy_volume_from_snapshot" :: held 9.054s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96-5cb87c96-b57d-40d3-9ffe-730fa3f17713" released by "_create_volume_from_snapshot" :: held 9.114s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.204s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.228s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291275577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee8113a-c4d7-4253-a454-577d68339064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:15Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume fee8113a-c4d7-4253-a454-577d68339064 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:23 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:23 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 1073741824 Apr 28 05:05:23 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c89440a-21f5-45ca-bcc7-2bb9a22df69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713', 'volume_size': 1, 'snapshot_id': '2616b6f7-f356-4270-a11e-d21356bbeb96'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57146ef0-7c06-45a3-a6a1-c54b0f0c7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:23 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Volume volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 (5cb87c96-b57d-40d3-9ffe-730fa3f17713): created successfully Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57146ef0-7c06-45a3-a6a1-c54b0f0c7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (918cf192-03a9-4379-bbe1-6ad4773cb67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:23 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-12990639-2835-493f-b0fa-55fd7ffc18ee tempest-VolumeDependencyTests-1235887502 None] Created volume successfully. Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-2616b6f7-f356-4270-a11e-d21356bbeb96-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-2616b6f7-f356-4270-a11e-d21356bbeb96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Deleting offline snapshot 2616b6f7-f356-4270-a11e-d21356bbeb96 of volume e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] snapshot_file for this snap is: volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3f4c7-07d5-4090-82e0-e2201ad58890]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:23 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:23 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:23 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:24 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 1073741824" returned: 0 in 0.753s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:24 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 Apr 28 05:05:24 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:24 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (a8b9121f-8544-4477-b16b-0e901e31d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47299d-c11c-45bd-853d-9dff8c5a60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 0.705s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1eed1cc-9a60-4022-be15-a7b198bd3403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f3886-42ef-4f92-944e-acd0bf5d3c23]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47299d-c11c-45bd-853d-9dff8c5a60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755782559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e5e8a1-7424-421f-8c05-4bef19dbd41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:24Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22596a1e-6716-4e8e-9e0d-2beec9a39890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22596a1e-6716-4e8e-9e0d-2beec9a39890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd32f06-354c-40d0-9bf3-f500593aecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd32f06-354c-40d0-9bf3-f500593aecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e5e8a1-7424-421f-8c05-4bef19dbd41c', 'volume_name': 'volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4182e154-f4e6-4010-96d7-6b61f929d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4182e154-f4e6-4010-96d7-6b61f929d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196bc3b6-d962-48c7-8943-1f2320bf94ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume c4e5e8a1-7424-421f-8c05-4bef19dbd41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c', 'volume_size': 1} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:24 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:24 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:24 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064" returned: 0 in 0.518s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.106s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1817918183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbb239-28a2-4b56-8414-c2908c94d13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:15Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume 05cbb239-28a2-4b56-8414-c2908c94d13d {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:24 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:24 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d 1073741824 Apr 28 05:05:24 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c230d1-b0af-4861-b938-6e76b289ceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee8113a-c4d7-4253-a454-577d68339064', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a6dbf-c5c8-4680-bc31-52f3c39820cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:24 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-fee8113a-c4d7-4253-a454-577d68339064 (fee8113a-c4d7-4253-a454-577d68339064): created successfully Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a6dbf-c5c8-4680-bc31-52f3c39820cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:24 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (4886af32-bdcb-4c5e-a689-c0fd25738f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:24 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6561de7c-7211-4823-9bb8-555f9ee87880 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:25 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.552s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:25 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:25 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:25 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d 1073741824" returned: 0 in 0.645s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:25 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d Apr 28 05:05:25 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:25 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 0.617s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:25 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96 Apr 28 05:05:25 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:25 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d" returned: 0 in 0.428s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.712s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490787075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43b81a0-7345-4ec0-9add-3eea3374f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:16Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume a43b81a0-7345-4ec0-9add-3eea3374f785 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:25 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac610a9a-f668-4977-9c0f-be516e0e7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cbb239-28a2-4b56-8414-c2908c94d13d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bc0670-6b77-4793-b724-78421af7743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:25 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 1073741824 Apr 28 05:05:25 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:25 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-05cbb239-28a2-4b56-8414-c2908c94d13d (05cbb239-28a2-4b56-8414-c2908c94d13d): created successfully Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bc0670-6b77-4793-b724-78421af7743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:25 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (496bdb13-b742-40d3-b368-acfeecc8bb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:25 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bc032973-ebab-4d6d-973b-da2f45c0f75a tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:26 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403.2616b6f7-f356-4270-a11e-d21356bbeb96" returned: 0 in 0.463s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-2616b6f7-f356-4270-a11e-d21356bbeb96" released by "_delete_snapshot" :: held 2.438s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" released by "delete_snapshot" :: held 2.459s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Created reservations ['38ad3a94-c24d-42bc-9e61-7ad68e5c0db4', '7306b634-553b-4bce-9697-02f768af09e7', 'fbd25c94-3b31-4f7c-9f51-d4f2eacf470b', '5abeaf30-4b53-4c86-b73b-cf3bb3c415be'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:26 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Delete snapshot completed successfully. Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e77c127a-90b7-4b7a-bc51-5328023687bd tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-2616b6f7-f356-4270-a11e-d21356bbeb96-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:26 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 1073741824" returned: 0 in 0.669s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:26 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 Apr 28 05:05:26 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-e1eed1cc-9a60-4022-be15-a7b198bd3403-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:26 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785" returned: 0 in 0.455s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-e1eed1cc-9a60-4022-be15-a7b198bd3403-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.637s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182757144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb12bd2-8689-4d54-8f7a-83081af9c7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:16Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume 4fb12bd2-8689-4d54-8f7a-83081af9c7fe {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:26 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:27 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa05235-71ad-442a-9d5a-ebd68bb5f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43b81a0-7345-4ec0-9add-3eea3374f785', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:27 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe 1073741824 Apr 28 05:05:27 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b401f7-39bd-4b9a-bb7e-90dce306baca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:27 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-a43b81a0-7345-4ec0-9add-3eea3374f785 (a43b81a0-7345-4ec0-9add-3eea3374f785): created successfully Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b401f7-39bd-4b9a-bb7e-90dce306baca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (a52ca777-2217-432d-8527-57f7041f7cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:27 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e3403eff-80e9-4050-a11b-666a0b1851b3 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9980da5-1741-4dfc-9905-627924fb1e6f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:27 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:27 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:27 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe 1073741824" returned: 0 in 0.667s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:27 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe Apr 28 05:05:27 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:27 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.593s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:27 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:27 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403 Apr 28 05:05:27 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:28 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" returned: 0 in 0.443s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.386s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156433496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17329e7-32eb-4fd8-a459-d62494e153c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff27ed4a573e4540aa39616b04d753cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:17Z,use_quota=True,user_id='52df1aba61214866b496ca6da5d5cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Creating volume e17329e7-32eb-4fd8-a459-d62494e153c6 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:28 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a54001-5434-4285-96c2-af796c9d62eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:28 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5546edc7-e0b4-4f6f-822f-d93e8629df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:28 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 1073741824 Apr 28 05:05:28 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e1eed1cc-9a60-4022-be15-a7b198bd3403" returned: 0 in 0.456s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:28 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe (4fb12bd2-8689-4d54-8f7a-83081af9c7fe): created successfully Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5546edc7-e0b4-4f6f-822f-d93e8629df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (8d1094f3-a757-4082-af89-bf5c64fbf205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-e1eed1cc-9a60-4022-be15-a7b198bd3403" released by "delete_volume" :: held 1.122s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b4f03432-8b7b-4c16-b7c0-c443c65ab024 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Created reservations ['a1f89914-fe72-434f-8544-0f1062345fd4', 'f5e3c35c-3aaf-4ee4-84b4-23cd3b64c5e6', '9ec37bb9-099c-49e1-9fa4-4ee7034002ec', '4242995b-4f97-49dc-b59d-b5c63c7345e1'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:28 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:28 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:28 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 1073741824" returned: 0 in 0.648s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:28 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.511s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:28 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 Apr 28 05:05:28 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:28 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Deleted volume successfully. Apr 28 05:05:28 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-ec31761f-b3c8-494e-bf01-0eda40b97bb8 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-e1eed1cc-9a60-4022-be15-a7b198bd3403-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:29 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6" returned: 0 in 0.482s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.260s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1287494344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fe16f7-e5c8-4115-92ab-1a8184259a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1140fbe8d542c0a54c6f829e809a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:18Z,use_quota=True,user_id='fec9c1ab9c8c43529e4ac29c6ece7d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Creating volume 71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:29 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163095a9-e245-4211-9e4b-a7fac27b01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17329e7-32eb-4fd8-a459-d62494e153c6', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d 1073741824 Apr 28 05:05:29 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ffb96-610c-4dae-89c6-a4ed84fa6a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Volume volume-e17329e7-32eb-4fd8-a459-d62494e153c6 (e17329e7-32eb-4fd8-a459-d62494e153c6): created successfully Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ffb96-610c-4dae-89c6-a4ed84fa6a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Flow 'volume_create_manager' (03309eb5-9155-4e5c-9404-eedeb92e095a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:29 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-17bbe51c-ce89-4638-bb3e-5fa53ae0f5e9 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created volume successfully. Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (d6ef9895-1b97-4bcf-b89c-604e846cd125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7767d1d7-c1cb-4f62-8d3c-4506e7a76d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7767d1d7-c1cb-4f62-8d3c-4506e7a76d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-987774071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec87780-b170-460e-bc51-964a50ad7d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:29Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf645b0-6c1c-4773-91ba-9d25f67beb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf645b0-6c1c-4773-91ba-9d25f67beb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98be3cd5-bef2-4196-a687-643a169f8324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98be3cd5-bef2-4196-a687-643a169f8324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec87780-b170-460e-bc51-964a50ad7d5f', 'volume_name': 'volume-eec87780-b170-460e-bc51-964a50ad7d5f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeece27-f153-47bf-ba9d-a2378820b2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeece27-f153-47bf-ba9d-a2378820b2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c33570e-320c-4ae8-abfe-46966474c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:29 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Volume eec87780-b170-460e-bc51-964a50ad7d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec87780-b170-460e-bc51-964a50ad7d5f', 'volume_size': 1} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-e17329e7-32eb-4fd8-a459-d62494e153c6-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-e17329e7-32eb-4fd8-a459-d62494e153c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-e17329e7-32eb-4fd8-a459-d62494e153c6" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-e17329e7-32eb-4fd8-a459-d62494e153c6" acquired by "delete_volume" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc79bfe-acf9-443d-ad87-8030fba6f0e1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:29 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:30 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d 1073741824" returned: 0 in 0.680s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:30 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 Apr 28 05:05:30 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:30 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:05:30 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:30 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6" returned: 0 in 0.522s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:30 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6 Apr 28 05:05:30 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:30 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755782559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e5e8a1-7424-421f-8c05-4bef19dbd41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:24Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume c4e5e8a1-7424-421f-8c05-4bef19dbd41c {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:30 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb18457-7cbc-4cc2-8738-308ec294e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a898f1d7-7bcf-4e08-8211-c55a014b43b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:30 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c 1073741824 Apr 28 05:05:30 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:30 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Volume volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d (71fe16f7-e5c8-4115-92ab-1a8184259a0d): created successfully Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a898f1d7-7bcf-4e08-8211-c55a014b43b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Flow 'volume_create_manager' (9c7bedf4-e7ca-4096-ad30-641b700ea4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:30 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-30ecb783-8bae-4c84-8ddc-8916309491e7 tempest-SnapshotDependencyTests-2028582814 None] Created volume successfully. Apr 28 05:05:30 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-e17329e7-32eb-4fd8-a459-d62494e153c6" returned: 0 in 0.471s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:30 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-e17329e7-32eb-4fd8-a459-d62494e153c6" released by "delete_volume" :: held 1.032s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['87527818-69df-4fb0-a8f6-b19579947d7f', '321ec5ca-7842-4a6b-b670-0f8e08fb2137', '790ca4f0-c9fc-4466-b187-9656cf198ab3', '56830863-c49f-4a3b-a581-1a128c6ebaa6'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:31 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:31 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:31 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c 1073741824" returned: 0 in 0.635s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:31 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c Apr 28 05:05:31 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:31 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.449s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-29e27573-cd32-477b-bde0-abd16024c444 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-e17329e7-32eb-4fd8-a459-d62494e153c6-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:31 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-987774071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec87780-b170-460e-bc51-964a50ad7d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:29Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Creating volume eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:31 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:31 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f 1073741824 Apr 28 05:05:31 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196bc3b6-d962-48c7-8943-1f2320bf94ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d033fe-ac4c-4c0c-a67f-d914adda5e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:31 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c (c4e5e8a1-7424-421f-8c05-4bef19dbd41c): created successfully Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d033fe-ac4c-4c0c-a67f-d914adda5e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (a8b9121f-8544-4477-b16b-0e901e31d019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:31 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-adc40ccc-4b21-468a-9c3f-3508e6719106 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:31 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-4fb12bd2-8689-4d54-8f7a-83081af9c7fe-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-4fb12bd2-8689-4d54-8f7a-83081af9c7fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed78484f-66c2-411a-a068-8ea6c3052408]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:32 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe Apr 28 05:05:32 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (41b45692-4fdb-4739-b248-dae322e78531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a4533-6bc7-49d2-8ac5-de8fa0989e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a4533-6bc7-49d2-8ac5-de8fa0989e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575307950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62c8f75-24b8-44bb-b934-53bb0d1a45a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:32Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8c4d90-c4ac-4a5c-8811-bbe9e7d74505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8c4d90-c4ac-4a5c-8811-bbe9e7d74505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fa33af-03cc-4844-bf2a-fdf1598a3e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fa33af-03cc-4844-bf2a-fdf1598a3e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62c8f75-24b8-44bb-b934-53bb0d1a45a3', 'volume_name': 'volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f078a0f-1a15-4d7e-a747-005d1acd2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f078a0f-1a15-4d7e-a747-005d1acd2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7831b400-437a-43cf-9824-a7fa2c1a4c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume f62c8f75-24b8-44bb-b934-53bb0d1a45a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3', 'volume_size': 1} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f 1073741824" returned: 0 in 0.736s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:32 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:32 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (b4b0f770-1ca8-4e6b-a40b-cbe4f75894a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89fa0eb-be1a-4ca8-b768-716ec2d9b958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89fa0eb-be1a-4ca8-b768-716ec2d9b958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-779237340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96028f4a-d9ef-493d-988d-7f232c19cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32e57c3-a951-442a-bc20-0fdd30b13a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32e57c3-a951-442a-bc20-0fdd30b13a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5d30ff-8fe7-4e2d-b594-8d846bd1a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5d30ff-8fe7-4e2d-b594-8d846bd1a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96028f4a-d9ef-493d-988d-7f232c19cbad', 'volume_name': 'volume-96028f4a-d9ef-493d-988d-7f232c19cbad', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e499a8e-6755-4586-97e2-6dd5ba5eb44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e499a8e-6755-4586-97e2-6dd5ba5eb44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d229e76-9f49-47c3-ae90-d36d285435ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:32 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume 96028f4a-d9ef-493d-988d-7f232c19cbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96028f4a-d9ef-493d-988d-7f232c19cbad', 'volume_size': 1} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:32 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" returned: 0 in 0.688s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:32 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:32 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe Apr 28 05:05:32 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:33 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (795b4bb4-38ce-4f4a-82cd-cf6938aa683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc569a18-1166-4788-8733-358e691e8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc569a18-1166-4788-8733-358e691e8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697094521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25cef49-3e4e-449f-ba50-7c59bf1c9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7965a8-b471-46c3-a225-687fdb732214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7965a8-b471-46c3-a225-687fdb732214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ea2faf-f390-4b4b-9d21-b63bc0c75f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ea2faf-f390-4b4b-9d21-b63bc0c75f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25cef49-3e4e-449f-ba50-7c59bf1c9cb8', 'volume_name': 'volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14306e3-3ce1-4a53-8b5d-13cbc31ac038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14306e3-3ce1-4a53-8b5d-13cbc31ac038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1109e14-837b-4761-9c6e-7a57ce6ab8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume b25cef49-3e4e-449f-ba50-7c59bf1c9cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8', 'volume_size': 1} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.636s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.188s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Creating offline snapshot c8a0b0dd-a973-4585-9e08-2a61fae20612 of volume 71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c33570e-320c-4ae8-abfe-46966474c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec87780-b170-460e-bc51-964a50ad7d5f', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78367f21-c777-451f-8b24-0a731fb852c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[15604ba8-1314-4d86-b47b-d21e47228807]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Volume volume-eec87780-b170-460e-bc51-964a50ad7d5f (eec87780-b170-460e-bc51-964a50ad7d5f): created successfully Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78367f21-c777-451f-8b24-0a731fb852c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (d6ef9895-1b97-4bcf-b89c-604e846cd125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:33 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-af4a0524-d0b3-41d8-aa78-4d887a9dfd47 tempest-VolumeDependencyTests-1235887502 None] Created volume successfully. Apr 28 05:05:33 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:05:33 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (207c0006-74e5-485b-9853-32483d593711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed148729-a177-48a2-be17-81e3fc7a6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed148729-a177-48a2-be17-81e3fc7a6d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013304824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ad6a4-169d-4509-941e-7665fde4ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecbfffa-3db4-4e08-833a-76a5158ae698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecbfffa-3db4-4e08-833a-76a5158ae698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c25ace-1c4d-4eaf-9ecb-ffab2a028df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c25ace-1c4d-4eaf-9ecb-ffab2a028df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271ad6a4-169d-4509-941e-7665fde4ff21', 'volume_name': 'volume-271ad6a4-169d-4509-941e-7665fde4ff21', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8eaadd-3d74-43b1-acf4-b4f2c2ff79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8eaadd-3d74-43b1-acf4-b4f2c2ff79d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b88b926-e7c1-4901-8356-d49a0290bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume 271ad6a4-169d-4509-941e-7665fde4ff21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271ad6a4-169d-4509-941e-7665fde4ff21', 'volume_size': 1} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:33 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-4fb12bd2-8689-4d54-8f7a-83081af9c7fe" released by "delete_volume" :: held 1.331s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['739c2f6a-cae1-4a26-ac1f-0efe02b9d5f4', '8179625d-891d-440a-b0f4-0e307f08a708', 'd1b5622e-a4d7-471a-ba98-7eedf76657ff', 'ad0c7a15-0ae4-4cc2-a37f-2a3679f88c68'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (6cab7821-1bbb-443e-a8ae-368c1ad84e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117bce10-8b0e-47a3-8ab7-8b958c3f6e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117bce10-8b0e-47a3-8ab7-8b958c3f6e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559656364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2882a65-5de1-48b9-a5ca-60baf23dda4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:34Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7813891-7130-41f6-8128-d982ed6b0d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7813891-7130-41f6-8128-d982ed6b0d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dee8cd-52f9-4930-88b2-3de742ea2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dee8cd-52f9-4930-88b2-3de742ea2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2882a65-5de1-48b9-a5ca-60baf23dda4a', 'volume_name': 'volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f115acf-2566-4e85-83e1-01c540ba0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f115acf-2566-4e85-83e1-01c540ba0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a04ead7-c3c7-47f3-93a3-32dafb14093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:33 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume a2882a65-5de1-48b9-a5ca-60baf23dda4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a', 'volume_size': 1} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:33 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.647s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:33 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:33 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:33 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:33 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 1G Apr 28 05:05:33 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (8a91b40e-274d-4b35-95e8-c7deda587bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6305b4cd-7f78-4c34-b2b6-1a41c4713489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:34 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6305b4cd-7f78-4c34-b2b6-1a41c4713489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803194675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859f1c9f-a8f7-4f9c-95d5-8be13af978b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0586a59b57414057be9fac82f1d353b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=eec87780-b170-460e-bc51-964a50ad7d5f,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:34Z,use_quota=True,user_id='18959407d0904fcab13c897bdd8eaae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691b7ebf-7f01-49e7-9428-6beea12bf40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691b7ebf-7f01-49e7-9428-6beea12bf40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1581bbc2-e6b3-4328-aed7-d8fb65676dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1581bbc2-e6b3-4328-aed7-d8fb65676dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '859f1c9f-a8f7-4f9c-95d5-8be13af978b7', 'volume_name': 'volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7', 'volume_size': 1, 'source_volid': 'eec87780-b170-460e-bc51-964a50ad7d5f', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f061e-de6e-44bc-bd80-d88596e3d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755f061e-de6e-44bc-bd80-d88596e3d30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671946d2-05c5-443f-8ead-cbc9f8ff2564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:34 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Volume 859f1c9f-a8f7-4f9c-95d5-8be13af978b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7', 'volume_size': 1, 'source_volid': 'eec87780-b170-460e-bc51-964a50ad7d5f', 'source_volstatus': 'available'} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.541s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:34 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-2b8d5f2a-5b6e-4bd9-ae0c-c63bc6579d6f tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-4fb12bd2-8689-4d54-8f7a-83081af9c7fe-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-a43b81a0-7345-4ec0-9add-3eea3374f785-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-a43b81a0-7345-4ec0-9add-3eea3374f785-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-a43b81a0-7345-4ec0-9add-3eea3374f785" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-a43b81a0-7345-4ec0-9add-3eea3374f785" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71caace-c910-4ee6-8ca4-84d2595abbe7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:34 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 1G" returned: 0 in 0.713s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:34 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:34 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:05:34 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:34 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 Apr 28 05:05:34 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:35 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.495s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:35 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 is being set with open permissions: ugo+rw Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:35 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785" returned: 0 in 0.537s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:35 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:05:35 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:35 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785 Apr 28 05:05:35 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:35 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:35 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a43b81a0-7345-4ec0-9add-3eea3374f785" returned: 0 in 0.456s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-a43b81a0-7345-4ec0-9add-3eea3374f785" released by "delete_volume" :: held 1.045s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:35 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info Apr 28 05:05:35 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['d9fdd4f3-9639-48ab-8f8d-49a7b5b83b06', 'f9397ba1-dbd7-4d87-a5a1-3390b7a8c559', 'a1263579-f3bf-4e96-a5c2-dda9c9adfdc9', 'b6fa4e25-cff0-473a-9910-529c6277af36'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:35 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:35 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:35 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info" returned: 0 in 0.474s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:35 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info is being set with open permissions: ugo+rw Apr 28 05:05:35 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:36 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info Apr 28 05:05:36 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:36 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.442s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e0d34375-d0d3-4a75-8c35-33e792d7f205 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-a43b81a0-7345-4ec0-9add-3eea3374f785-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:36 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.info" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.037s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575307950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62c8f75-24b8-44bb-b934-53bb0d1a45a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:32Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume f62c8f75-24b8-44bb-b934-53bb0d1a45a3 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:36 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:36 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 1073741824 Apr 28 05:05:36 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:36 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-25e453ae-2d12-4984-81a8-4207fa93ebdd tempest-SnapshotDependencyTests-2028582814 None] Create snapshot completed successfully Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-05cbb239-28a2-4b56-8414-c2908c94d13d-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-05cbb239-28a2-4b56-8414-c2908c94d13d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-05cbb239-28a2-4b56-8414-c2908c94d13d" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-05cbb239-28a2-4b56-8414-c2908c94d13d" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e813f-0855-404f-af88-6340f88a881c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:36 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:36 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d Apr 28 05:05:36 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:37 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 1073741824" returned: 0 in 0.663s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:37 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 Apr 28 05:05:37 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:37 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d" returned: 0 in 0.605s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:37 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d Apr 28 05:05:37 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:37 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" returned: 0 in 0.509s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.858s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-779237340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96028f4a-d9ef-493d-988d-7f232c19cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume 96028f4a-d9ef-493d-988d-7f232c19cbad {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:37 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7831b400-437a-43cf-9824-a7fa2c1a4c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce808319-481b-41e1-8cda-54c4ff4b9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad 1073741824 Apr 28 05:05:37 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Flow 'volume_create_manager' (22bc625b-6c9f-4f2c-b441-cd75c6227343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9058038c-cfb0-4527-aeb7-a53781bc80ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9058038c-cfb0-4527-aeb7-a53781bc80ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bacbe45-df33-4b9b-b29e-66bc227e3181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1140fbe8d542c0a54c6f829e809a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8a0b0dd-a973-4585-9e08-2a61fae20612,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:38Z,use_quota=True,user_id='fec9c1ab9c8c43529e4ac29c6ece7d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ca69b1-b5b5-4f88-b68f-597dd08b6120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ca69b1-b5b5-4f88-b68f-597dd08b6120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1cd867-9dd1-4c15-8ec0-2e2bc810daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1cd867-9dd1-4c15-8ec0-2e2bc810daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9bacbe45-df33-4b9b-b29e-66bc227e3181', 'volume_name': 'volume-9bacbe45-df33-4b9b-b29e-66bc227e3181', 'volume_size': 1, 'snapshot_id': 'c8a0b0dd-a973-4585-9e08-2a61fae20612'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349a70bc-bd34-4a6a-b5b8-e3bf787be74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349a70bc-bd34-4a6a-b5b8-e3bf787be74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389447fb-a6c5-4b66-8fcb-57f6ea4b6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:37 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Volume 9bacbe45-df33-4b9b-b29e-66bc227e3181: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9bacbe45-df33-4b9b-b29e-66bc227e3181', 'volume_size': 1, 'snapshot_id': 'c8a0b0dd-a973-4585-9e08-2a61fae20612'} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:37 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 (f62c8f75-24b8-44bb-b934-53bb0d1a45a3): created successfully Apr 28 05:05:37 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce808319-481b-41e1-8cda-54c4ff4b9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (41b45692-4fdb-4739-b248-dae322e78531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-05cbb239-28a2-4b56-8414-c2908c94d13d" returned: 0 in 0.507s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:37 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-638b10c8-2424-48a2-ac1e-ba4f3c97a381 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-05cbb239-28a2-4b56-8414-c2908c94d13d" released by "delete_volume" :: held 1.164s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['3e45c0c3-11ce-457c-8f4e-198187e6d1f7', '13efb370-e232-4f50-a843-6c01f43f2260', '03d6af1a-81eb-4dda-a5c5-3746f64d4571', 'a012e2f0-6044-481b-8442-3dc96bb5f471'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:37 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:37 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:37 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:38 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad 1073741824" returned: 0 in 0.637s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:38 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad Apr 28 05:05:38 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:38 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.487s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d44a8414-6cc5-45e1-87cc-89fe3773de04 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-05cbb239-28a2-4b56-8414-c2908c94d13d-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-fee8113a-c4d7-4253-a454-577d68339064-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:38 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad" returned: 0 in 0.496s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-fee8113a-c4d7-4253-a454-577d68339064-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.790s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697094521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25cef49-3e4e-449f-ba50-7c59bf1c9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:38 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:38 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 1073741824 Apr 28 05:05:38 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d229e76-9f49-47c3-ae90-d36d285435ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96028f4a-d9ef-493d-988d-7f232c19cbad', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d165bae9-7c3f-4ecc-b5fa-37d5f35e5c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:38 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-96028f4a-d9ef-493d-988d-7f232c19cbad (96028f4a-d9ef-493d-988d-7f232c19cbad): created successfully Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d165bae9-7c3f-4ecc-b5fa-37d5f35e5c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (b4b0f770-1ca8-4e6b-a40b-cbe4f75894a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:38 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-fee8113a-c4d7-4253-a454-577d68339064" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:38 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-f859cebf-d097-46ae-a42d-b0e2d72c3a3e tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-fee8113a-c4d7-4253-a454-577d68339064" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f31a04-b466-495a-bfe4-d31ff9b13ff0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:39 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 Apr 28 05:05:39 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:39 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 1073741824" returned: 0 in 0.653s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:39 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 Apr 28 05:05:39 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:39 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064" returned: 0 in 0.574s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:39 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:39 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064 Apr 28 05:05:39 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:40 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" returned: 0 in 0.455s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.585s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013304824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ad6a4-169d-4509-941e-7665fde4ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:33Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume 271ad6a4-169d-4509-941e-7665fde4ff21 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:40 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1109e14-837b-4761-9c6e-7a57ce6ab8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:40 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 1073741824 Apr 28 05:05:40 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5c3e61-926f-4cf1-8db2-8703c5177993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:40 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=126,cinder:INSERT=47,cinder:UPDATE=177,cinder:DELETE=19 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fee8113a-c4d7-4253-a454-577d68339064" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:40 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 (b25cef49-3e4e-449f-ba50-7c59bf1c9cb8): created successfully Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5c3e61-926f-4cf1-8db2-8703c5177993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (795b4bb4-38ce-4f4a-82cd-cf6938aa683d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-fee8113a-c4d7-4253-a454-577d68339064" released by "delete_volume" :: held 1.111s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:40 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-96554bd9-81e6-4969-98d9-37c40c96974c tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['ece40295-4e57-4e07-bbc1-43b861047568', 'c3609a5a-466a-4bfd-808a-efa87494f03e', '2f32c718-ca60-408f-ac0c-3c80aae45358', '8aedccf3-8ac3-4549-9ac3-5bd4b215a3fb'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:40 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:40 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:40 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.461s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:40 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:40 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 1073741824" returned: 0 in 0.688s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-e537fce5-596f-448b-9f75-b117c2d576e1 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-fee8113a-c4d7-4253-a454-577d68339064-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:40 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:40 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 Apr 28 05:05:40 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleting offline snapshot cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 of volume f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] snapshot_file for this snap is: volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbbe8b4-9d90-48e2-a578-273cead56647]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:41 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 Apr 28 05:05:41 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:41 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21" returned: 0 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.496s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559656364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2882a65-5de1-48b9-a5ca-60baf23dda4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a63b78ef1c40758ba47012c502eafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:05:34Z,use_quota=True,user_id='0486b112c9aa447d9563b251e504e2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Creating volume a2882a65-5de1-48b9-a5ca-60baf23dda4a {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:41 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b88b926-e7c1-4901-8356-d49a0290bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271ad6a4-169d-4509-941e-7665fde4ff21', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:41 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a 1073741824 Apr 28 05:05:41 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce26be1-2324-492e-a196-0eae8e538317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:41 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-271ad6a4-169d-4509-941e-7665fde4ff21 (271ad6a4-169d-4509-941e-7665fde4ff21): created successfully Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce26be1-2324-492e-a196-0eae8e538317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (207c0006-74e5-485b-9853-32483d593711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:41 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-0f935423-62c9-4398-89ab-e07cde547151 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:41 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" returned: 0 in 0.562s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6e842fc-7264-43b3-84b7-389017a1f76e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[671609fb-929c-4d37-92e5-8a2dc30f21e6]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:41 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e Apr 28 05:05:41 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:41 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a 1073741824" returned: 0 in 0.616s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:41 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:41 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a Apr 28 05:05:41 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:42 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e" returned: 0 in 0.555s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:42 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 Apr 28 05:05:42 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:42 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a" returned: 0 in 0.494s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.084s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:42 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Cloning volume eec87780-b170-460e-bc51-964a50ad7d5f to volume 859f1c9f-a8f7-4f9c-95d5-8be13af978b7 Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a04ead7-c3c7-47f3-93a3-32dafb14093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7f53e5-fe76-41c8-9be9-3d8e419da18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:42 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Volume volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a (a2882a65-5de1-48b9-a5ca-60baf23dda4a): created successfully Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7f53e5-fe76-41c8-9be9-3d8e419da18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Flow 'volume_create_manager' (6cab7821-1bbb-443e-a8ae-368c1ad84e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:42 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-ba854a8e-f142-40c0-b609-8c57cbba0f73 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created volume successfully. Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Creating offline snapshot 3d90f82b-578e-4092-86d6-c5d6cd58a627 of volume eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec5871-cde7-4ff0-ae67-bf86e57502d0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:42 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:42 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:42 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" returned: 0 in 0.533s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:42 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:42 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37 Apr 28 05:05:42 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:43 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.554s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:43 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 1G Apr 28 05:05:43 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:43 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e.cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" returned: 0 in 0.452s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37" released by "_delete_snapshot" :: held 2.205s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" released by "delete_snapshot" :: held 2.230s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['24ac3506-60e1-4ac0-9f73-c2b00299ab3d', '48ff1c35-3ca6-4806-ad68-8617530d41e1', '070b5faf-47d9-404e-a41c-a8bfe9310f0e', '5a5fb1c7-88c8-44c2-9adb-c10f5cb0d341'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:43 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Delete snapshot completed successfully. Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bdcb7fa7-9f34-41b0-8c63-af74330aa207 tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-cebbb057-bd0d-4b55-b2e9-7a6e85fa3a37-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-a2882a65-5de1-48b9-a5ca-60baf23dda4a-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-a2882a65-5de1-48b9-a5ca-60baf23dda4a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-a2882a65-5de1-48b9-a5ca-60baf23dda4a" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-a2882a65-5de1-48b9-a5ca-60baf23dda4a" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54518ac-07e2-48f4-a021-12a7ed7ff308]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:43 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 1G" returned: 0 in 0.669s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:43 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec87780-b170-460e-bc51-964a50ad7d5f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:43 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a Apr 28 05:05:43 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:43 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec87780-b170-460e-bc51-964a50ad7d5f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:43 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a" returned: 0 in 0.543s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-f6e842fc-7264-43b3-84b7-389017a1f76e-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:44 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:44 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a Apr 28 05:05:44 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec87780-b170-460e-bc51-964a50ad7d5f -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.525s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:44 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 is being set with open permissions: ugo+rw Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-f6e842fc-7264-43b3-84b7-389017a1f76e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:44 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:44 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d177c456-5b2f-4c7e-a317-377c366b884a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:44 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e Apr 28 05:05:44 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-a2882a65-5de1-48b9-a5ca-60baf23dda4a" returned: 0 in 0.453s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-a2882a65-5de1-48b9-a5ca-60baf23dda4a" released by "delete_volume" :: held 1.038s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:44 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.486s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['3909491c-cae9-446f-9664-a92e8596cb4d', '1cf3e476-052f-4b24-9ae4-63acf501f09b', '76913f47-0cac-43ea-b3c9-21d38c0bb9d4', '879d49bd-947b-4013-b92c-0a62c309df66'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:44 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info Apr 28 05:05:44 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:44 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:44 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:44 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e" returned: 0 in 0.586s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:44 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:45 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e Apr 28 05:05:45 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:45 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info" returned: 0 in 0.479s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:45 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info is being set with open permissions: ugo+rw Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:45 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info Apr 28 05:05:45 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:45 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.449s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:45 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-60a6507f-f631-4260-88f9-428e55670ff7 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-a2882a65-5de1-48b9-a5ca-60baf23dda4a-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:45 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f6e842fc-7264-43b3-84b7-389017a1f76e" returned: 0 in 0.469s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-quobyte-f6e842fc-7264-43b3-84b7-389017a1f76e" released by "delete_volume" :: held 1.110s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Created reservations ['524a7649-3ba1-4500-9fd6-8d734479acb0', '2f171b71-502f-4936-9d2c-d5218750c65f', 'e1e6f9c2-5831-413a-8df8-b02ab9fdcf6e', 'edad7b9d-7afe-4e0c-9592-32ab72fc07b8'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:45 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:45 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:45 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.info" returned: 0 in 0.445s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] snapshot: 3d90f82b-578e-4092-86d6-c5d6cd58a627, volume: 859f1c9f-a8f7-4f9c-95d5-8be13af978b7, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c4685-50df-4924-9bb0-c6aa1ca86143]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-271ad6a4-169d-4509-941e-7665fde4ff21-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-271ad6a4-169d-4509-941e-7665fde4ff21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:45 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:45 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-271ad6a4-169d-4509-941e-7665fde4ff21" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-271ad6a4-169d-4509-941e-7665fde4ff21" acquired by "delete_volume" :: waited 0.012s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[33679e60-2134-40c4-a51d-21f869c82747]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:45 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:46 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 Apr 28 05:05:46 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:46 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.503s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:46 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Deleted volume successfully. Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-70e67f69-e2fb-4f74-a1e8-339fc476279b tempest-CreateVolumesFromSnapshotTest-745633016 None] Lock "cinder-f6e842fc-7264-43b3-84b7-389017a1f76e-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:46 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.567s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec87780-b170-460e-bc51-964a50ad7d5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ed189-82fb-41d6-85c5-10460a925376]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:46 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:46 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:46 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21" returned: 0 in 0.566s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:46 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:46 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21 Apr 28 05:05:46 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:47 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.623s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:47 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 Apr 28 05:05:47 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:47 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-271ad6a4-169d-4509-941e-7665fde4ff21" returned: 0 in 0.559s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-271ad6a4-169d-4509-941e-7665fde4ff21" released by "delete_volume" :: held 1.169s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['ae81b9e8-a93e-4a24-8b51-5ad9d0fc6762', 'a4e5e1c2-e085-4fc0-818a-dd5f518c6910', '6d2573bf-d20b-464b-9de3-2c53fb9edc81', 'a549bb7f-4762-4292-95f8-d568d2a592b7'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:47 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:47 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:47 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.517s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:47 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:47 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9db1dc9e-a8ba-42d9-bc72-f08e623cac27 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-271ad6a4-169d-4509-941e-7665fde4ff21-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" acquired by "delete_volume" :: waited 0.027s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ee85f-d97a-423a-b090-f8df79353f15]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:48 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:48 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 Apr 28 05:05:48 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:49 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" returned: 0 in 1.239s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:49 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:49 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8 Apr 28 05:05:49 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:50 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" returned: 0 in 1.017s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8" released by "delete_volume" :: held 2.327s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['f2d0d91a-9778-469f-a6f8-f5795b77be3b', '73a9297a-4ddf-47fb-97d7-81b57fe6c821', '65c390cc-c58a-46aa-a5a2-e1415bdd4885', 'cc9be396-312a-4084-8cff-7fbfed5bcad9'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:50 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:50 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:50 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-96028f4a-d9ef-493d-988d-7f232c19cbad-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-96028f4a-d9ef-493d-988d-7f232c19cbad-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-96028f4a-d9ef-493d-988d-7f232c19cbad" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-96028f4a-d9ef-493d-988d-7f232c19cbad" acquired by "delete_volume" :: waited 0.032s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230f24d-304d-4342-8b8c-c721792c51a9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:51 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:52 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.187s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:52 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9baf388e-cd88-477f-8523-14c191f4454a tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-b25cef49-3e4e-449f-ba50-7c59bf1c9cb8-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:52 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad Apr 28 05:05:52 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:52 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" returned: 0 in 5.361s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[957bd3dc-b64b-4855-80d7-f8e27636c6a3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:52 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:52 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:52 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad" returned: 0 in 0.762s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:52 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:52 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad Apr 28 05:05:52 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:53 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.659s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:05:53 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Converted 1024.00 MB image at 190.99 MB/s Apr 28 05:05:53 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 is being set with open permissions: ugo+rw Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:53 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 Apr 28 05:05:53 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:53 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-96028f4a-d9ef-493d-988d-7f232c19cbad" returned: 0 in 0.432s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-96028f4a-d9ef-493d-988d-7f232c19cbad" released by "delete_volume" :: held 1.268s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['30e3948f-4e14-46b8-bc63-3fccb80c871e', '86701fc9-3025-403d-b558-abdd5d9092bb', 'e147fa3c-97f9-42eb-bf86-f08503faa29b', '36c25206-fa21-4a34-ade6-7bf3286904e0'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:53 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:53 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:53 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" released by "_copy_volume_from_snapshot" :: held 7.792s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-3d90f82b-578e-4092-86d6-c5d6cd58a627" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-3d90f82b-578e-4092-86d6-c5d6cd58a627" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Deleting offline snapshot 3d90f82b-578e-4092-86d6-c5d6cd58a627 of volume eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] snapshot_file for this snap is: volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[249816a4-e759-452f-b339-0ac7f06e0e4f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:53 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:53 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:53 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:53 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:53 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a40222ea-ad22-42ff-94f2-94ebb8cd9bd3 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-96028f4a-d9ef-493d-988d-7f232c19cbad-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-f62c8f75-24b8-44bb-b934-53bb0d1a45a3-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-f62c8f75-24b8-44bb-b934-53bb0d1a45a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" acquired by "delete_volume" :: waited 0.019s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a728236-35df-49ba-956c-08b1b224c968]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:54 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.572s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec87780-b170-460e-bc51-964a50ad7d5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac35feb-9c8c-4bbf-8234-15a6607e5ae1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:54 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 Apr 28 05:05:54 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:54 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:54 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:54 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" returned: 0 in 0.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:54 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3 Apr 28 05:05:54 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:54 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.533s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:54 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:54 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:54 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:55 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" returned: 0 in 0.465s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-f62c8f75-24b8-44bb-b934-53bb0d1a45a3" released by "delete_volume" :: held 1.062s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['43c72a8f-d402-462c-84e6-0e38667da828', 'dabc7ec2-3dce-49b9-8ef2-f4fd72b0e3a4', '640dd010-e786-45e0-8890-d91515d41e8c', 'c1970816-dfda-4c06-a2a8-e2c437df3359'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:55 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.552s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:55 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627 Apr 28 05:05:55 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:55 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:55 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:55 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f.3d90f82b-578e-4092-86d6-c5d6cd58a627" returned: 0 in 0.436s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:55 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.441s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-3d90f82b-578e-4092-86d6-c5d6cd58a627" released by "_delete_snapshot" :: held 2.180s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:55 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.379s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-9fb14b5c-27de-4b41-b2d8-ebf3663b01cf tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-f62c8f75-24b8-44bb-b934-53bb0d1a45a3-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612-9bacbe45-df33-4b9b-b29e-66bc227e3181" by "_create_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671946d2-05c5-443f-8ead-cbc9f8ff2564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7', 'volume_size': 1, 'source_volid': 'eec87780-b170-460e-bc51-964a50ad7d5f', 'source_volstatus': 'available'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc74212-cc8d-4780-a021-6435585ac8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612-9bacbe45-df33-4b9b-b29e-66bc227e3181" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Creating volume 9bacbe45-df33-4b9b-b29e-66bc227e3181 from snapshot c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" by "_copy_volume_from_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:55 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Volume volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 (859f1c9f-a8f7-4f9c-95d5-8be13af978b7): created successfully Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc74212-cc8d-4780-a021-6435585ac8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Flow 'volume_create_manager' (8a91b40e-274d-4b35-95e8-c7deda587bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] snapshot: c8a0b0dd-a973-4585-9e08-2a61fae20612, volume: 9bacbe45-df33-4b9b-b29e-66bc227e3181, {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:05:55 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9567f27f-e5f7-424a-9cb9-ab8c44549f57 tempest-VolumeDependencyTests-1235887502 None] Created volume successfully. Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[226a614d-d32e-469e-9705-c6ea61f6990e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:55 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:56 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:05:56 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-c4e5e8a1-7424-421f-8c05-4bef19dbd41c-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-c4e5e8a1-7424-421f-8c05-4bef19dbd41c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "cinder-quobyte-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa876365-eca2-4def-9695-8547e507ce5f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:56 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.532s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Creating direct copy from snapshot {{(pid=82097) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbe6c9f-509e-46e4-a4ad-ac3e44bf122f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:56 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c Apr 28 05:05:56 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_service.periodic_task [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:56 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:05:56 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:56 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:56 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-eec87780-b170-460e-bc51-964a50ad7d5f-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-eec87780-b170-460e-bc51-964a50ad7d5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-eec87780-b170-460e-bc51-964a50ad7d5f" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-eec87780-b170-460e-bc51-964a50ad7d5f" acquired by "delete_volume" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085db89-5587-4af7-834a-42a84e82539d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:56 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:56 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:56 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:57 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" returned: 0 in 0.571s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:57 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c Apr 28 05:05:57 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:57 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.547s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-571170d5-65fe-4cbd-8ef1-9248f34b1d72 None None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:57 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.621s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.utils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Path /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 not found in is_blk_device check {{(pid=82097) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:57 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 Apr 28 05:05:57 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:57 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:57 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f Apr 28 05:05:57 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:57 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" returned: 0 in 0.539s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-quobyte-c4e5e8a1-7424-421f-8c05-4bef19dbd41c" released by "delete_volume" :: held 1.150s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=156,cinder:UPDATE=223,cinder:INSERT=37,cinder:DELETE=22 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Created reservations ['c44a582f-1150-4ef1-9ab5-a0ef7f015a11', '44203227-a01c-4b85-9f3e-5025c6418d1a', '3f9aba89-b135-43a0-af6a-edccb0820e3d', '833254ab-db98-4daf-a729-53ed1b1f89b2'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:57 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:57 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:57 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:58 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-eec87780-b170-460e-bc51-964a50ad7d5f" returned: 0 in 0.729s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-eec87780-b170-460e-bc51-964a50ad7d5f" released by "delete_volume" :: held 1.384s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Created reservations ['e7b2bda4-620e-4962-8fd7-d66b5c4702d2', '588e6e2c-c78c-426b-863f-edd003e63ff2', '061fbaca-0d38-4aa2-a326-6445efecb8ea', '87e22b24-3bfa-45b4-8d69-887ae4fdf0ae'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:58 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:05:58 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:58 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.284s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:05:58 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:05:58 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Deleted volume successfully. Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-17206b25-5779-412f-bd19-d8bf281dc691 tempest-CreateVolumesFromSourceVolumeTest-1910010765 None] Lock "cinder-c4e5e8a1-7424-421f-8c05-4bef19dbd41c-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-859f1c9f-a8f7-4f9c-95d5-8be13af978b7-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-859f1c9f-a8f7-4f9c-95d5-8be13af978b7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" acquired by "delete_volume" :: waited 0.034s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f269b-4f8d-4148-9f67-9ad452a4b9b1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:05:59 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 Apr 28 05:05:59 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:05:59 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 28 05:05:59 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 1.549s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:00 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:00 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Deleted volume successfully. Apr 28 05:06:00 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-6bfeb7a8-b3f2-40c8-993a-d003f4eddf6e tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-eec87780-b170-460e-bc51-964a50ad7d5f-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:00 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" returned: 0 in 1.512s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:00 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:00 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7 Apr 28 05:06:01 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:02 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" returned: 0 in 1.133s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-859f1c9f-a8f7-4f9c-95d5-8be13af978b7" released by "delete_volume" :: held 2.729s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Created reservations ['14b7f92c-187f-40b7-9c93-0ad4c6835325', '90ff5d3e-77e1-468a-9004-0a4737b735b6', 'a603dc4b-2535-463b-bc30-493d7dd4fc91', 'c75b3361-ef04-4375-b394-0971918b6969'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:02 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:02 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-5cb87c96-b57d-40d3-9ffe-730fa3f17713-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:02 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-5cb87c96-b57d-40d3-9ffe-730fa3f17713-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" acquired by "delete_volume" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f41aa5-3443-4d87-8ca6-f6dc11c5b44f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:03 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181" returned: 0 in 5.955s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8e0a9-ad47-4b81-8989-2d343ec1fd01]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:03 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 Apr 28 05:06:03 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:03 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:03 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:06:03 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.858s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:03 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Deleted volume successfully. Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb470-7c02-4448-8ed6-e57145d3ddbc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-859f1c9f-a8f7-4f9c-95d5-8be13af978b7-delete_volume" released by "delete_volume" :: held 4.037s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:03 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713" returned: 0 in 0.586s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:03 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713 Apr 28 05:06:03 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:03 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.724s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.image.image_utils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Image conversion details: src /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 {{(pid=82097) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:06:03 devstack cinder-volume[82097]: INFO cinder.image.image_utils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Converted 1024.00 MB image at 171.85 MB/s Apr 28 05:06:03 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 is being set with open permissions: ugo+rw Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:03 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 Apr 28 05:06:03 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Flow 'volume_create_manager' (d9d13447-b44a-4ef8-b5df-45d47ab2ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf968e6f-f06d-4b34-9b16-4c10a0084af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf968e6f-f06d-4b34-9b16-4c10a0084af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bcd488-10cd-45e8-a64f-51c7c5963258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deacb3497464db6bc0fbb0cc0dc96d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:06:04Z,use_quota=True,user_id='76b633282838467a96f049a12b9964ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730ae032-2997-4947-9112-9c892da4ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:03 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730ae032-2997-4947-9112-9c892da4ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09570081-d00d-4b66-94f9-77d5679c2876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09570081-d00d-4b66-94f9-77d5679c2876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bcd488-10cd-45e8-a64f-51c7c5963258', 'volume_name': 'volume-f3bcd488-10cd-45e8-a64f-51c7c5963258', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff16b2ed-e8fd-4cc6-8f61-1dd83da9e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff16b2ed-e8fd-4cc6-8f61-1dd83da9e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fbb688-6b59-4c2e-a67e-e58df3a96692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:04 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Volume f3bcd488-10cd-45e8-a64f-51c7c5963258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bcd488-10cd-45e8-a64f-51c7c5963258', 'volume_size': 1} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:04 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-5cb87c96-b57d-40d3-9ffe-730fa3f17713" returned: 0 in 0.488s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-quobyte-5cb87c96-b57d-40d3-9ffe-730fa3f17713" released by "delete_volume" :: held 1.113s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Created reservations ['9adb8421-316a-409d-bb97-83c3ed0f8fb6', 'a8f84e00-74b0-4147-8348-0b1041eeec2b', '2d07d552-2c87-47e9-95ef-3fb1f7410dc2', '2d50095e-584f-4f1a-8b3e-e9ecbd5b924e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:04 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:04 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:04 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181" returned: 0 in 0.481s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" released by "_copy_volume_from_snapshot" :: held 8.430s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612-9bacbe45-df33-4b9b-b29e-66bc227e3181" released by "_create_volume_from_snapshot" :: held 8.481s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.510s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bcd488-10cd-45e8-a64f-51c7c5963258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deacb3497464db6bc0fbb0cc0dc96d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:06:04Z,use_quota=True,user_id='76b633282838467a96f049a12b9964ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Creating volume f3bcd488-10cd-45e8-a64f-51c7c5963258 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:06:04 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:04 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 1073741824 Apr 28 05:06:04 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389447fb-a6c5-4b66-8fcb-57f6ea4b6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bacbe45-df33-4b9b-b29e-66bc227e3181', 'volume_size': 1, 'snapshot_id': 'c8a0b0dd-a973-4585-9e08-2a61fae20612'}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b7ffa6-112b-42a2-97e1-66acf32b01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:04 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Volume volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 (9bacbe45-df33-4b9b-b29e-66bc227e3181): created successfully Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b7ffa6-112b-42a2-97e1-66acf32b01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Flow 'volume_create_manager' (22bc625b-6c9f-4f2c-b441-cd75c6227343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:06:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-bfa8adc1-b8ec-4c94-a646-d88bdda8d63a tempest-SnapshotDependencyTests-2028582814 None] Created volume successfully. Apr 28 05:06:04 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:04 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Deleted volume successfully. Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-8b4a89ee-5c9b-433e-8d64-569ce7e87ddc tempest-VolumeDependencyTests-1235887502 None] Lock "cinder-5cb87c96-b57d-40d3-9ffe-730fa3f17713-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:04 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 1073741824" returned: 0 in 0.617s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:04 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:05 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 Apr 28 05:06:05 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-c8a0b0dd-a973-4585-9e08-2a61fae20612-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-c8a0b0dd-a973-4585-9e08-2a61fae20612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Deleting offline snapshot c8a0b0dd-a973-4585-9e08-2a61fae20612 of volume 71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] snapshot_file for this snap is: volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff2bd4-bcf0-4de6-a398-e9d1cf8efbb4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:05 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:06:05 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:05 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258" returned: 0 in 0.504s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fbb688-6b59-4c2e-a67e-e58df3a96692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bcd488-10cd-45e8-a64f-51c7c5963258', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c50925f-f6c0-4e02-bf5e-11b0948356ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:05 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Volume volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 (f3bcd488-10cd-45e8-a64f-51c7c5963258): created successfully Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c50925f-f6c0-4e02-bf5e-11b0948356ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Flow 'volume_create_manager' (d9d13447-b44a-4ef8-b5df-45d47ab2ac49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:06:05 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-16bec0bf-2ace-46e1-b944-b7dd57acd71e tempest-CinderUnicodeTest-1223689758 None] Created volume successfully. Apr 28 05:06:05 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.599s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f3397c-f63f-4c00-aef7-56b5b458dd8f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:05 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:05 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:06:05 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:06 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.639s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:06 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:06:06 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82097) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Flow 'volume_create_manager' (e0dd762f-bfec-4c68-8e29-34b3e2a4b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1e7262-fda8-4bac-8eae-e0805591a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1e7262-fda8-4bac-8eae-e0805591a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:06:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2052843282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcebb16e-2aac-4acd-8729-e63cb103f4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deacb3497464db6bc0fbb0cc0dc96d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:06:06Z,use_quota=True,user_id='76b633282838467a96f049a12b9964ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d0859-118d-44a3-8320-9f2472c17ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d0859-118d-44a3-8320-9f2472c17ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7aa5e9-31fa-480e-8e5b-064717894316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7aa5e9-31fa-480e-8e5b-064717894316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcebb16e-2aac-4acd-8729-e63cb103f4b1', 'volume_name': 'volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64387045-de86-41c6-9eee-1adf0b85fb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64387045-de86-41c6-9eee-1adf0b85fb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0800dc4e-404f-439d-bfec-fe4c8c40b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:06 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Volume fcebb16e-2aac-4acd-8729-e63cb103f4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1', 'volume_size': 1} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:06:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2052843282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcebb16e-2aac-4acd-8729-e63cb103f4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deacb3497464db6bc0fbb0cc0dc96d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:06:06Z,use_quota=True,user_id='76b633282838467a96f049a12b9964ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6a2665-0249-4e4f-ba00-fef49cf05cd0),volume_type_id=1e6a2665-0249-4e4f-ba00-fef49cf05cd0)}" {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Creating volume fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Selected osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 as target Quobyte volume. {{(pid=82097) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:06:06 devstack cinder-volume[82097]: INFO cinder.volume.drivers.remotefs [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] casted to osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4 Apr 28 05:06:06 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 1073741824 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:06 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 1073741824 Apr 28 05:06:06 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:07 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.626s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:07 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612 Apr 28 05:06:07 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:07 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 1073741824" returned: 0 in 0.639s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:07 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 Apr 28 05:06:07 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:07 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d.c8a0b0dd-a973-4585-9e08-2a61fae20612" returned: 0 in 0.461s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-c8a0b0dd-a973-4585-9e08-2a61fae20612" released by "_delete_snapshot" :: held 2.433s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" released by "delete_snapshot" :: held 2.463s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Created reservations ['6cf78c8d-2d25-4e35-b3b6-13f77d88e500', 'dd09659c-245e-488b-8a2a-e1565139cae2', 'b554bb7e-5e8c-4ee4-91e0-6fb47e01b74f', '7840ec32-903d-4e64-a82c-837679bad57e'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:07 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Delete snapshot completed successfully. Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-c11ea90e-c8b3-4262-998e-ff730cd811b1 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-c8a0b0dd-a973-4585-9e08-2a61fae20612-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:07 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1" returned: 0 in 0.473s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'} {{(pid=82097) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0800dc4e-404f-439d-bfec-fe4c8c40b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1', 'volume_size': 1}' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5467eea0-7c45-40a3-aef1-7597c6f07f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:06:07 devstack cinder-volume[82097]: INFO cinder.volume.flows.manager.create_volume [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Volume volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 (fcebb16e-2aac-4acd-8729-e63cb103f4b1): created successfully Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5467eea0-7c45-40a3-aef1-7597c6f07f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82097) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:06:07 devstack cinder-volume[82097]: DEBUG cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Flow 'volume_create_manager' (e0dd762f-bfec-4c68-8e29-34b3e2a4b08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82097) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:06:07 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-9b9b8c5d-7441-4d73-9b73-763f56ad097b tempest-CinderUnicodeTest-1223689758 None] Created volume successfully. Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-71fe16f7-e5c8-4115-92ab-1a8184259a0d-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-71fe16f7-e5c8-4115-92ab-1a8184259a0d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" acquired by "delete_volume" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a54ffd-fae1-4c69-aaec-e313aa103ffd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:08 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:06:08 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Creating offline snapshot d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 of volume fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63701cc-6aa8-4a6e-a973-891285ddb8fc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:08 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.593s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:08 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:08 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d Apr 28 05:06:08 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:08 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 Apr 28 05:06:08 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:09 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-71fe16f7-e5c8-4115-92ab-1a8184259a0d" returned: 0 in 0.459s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-71fe16f7-e5c8-4115-92ab-1a8184259a0d" released by "delete_volume" :: held 1.111s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:09 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1" returned: 0 in 0.532s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 1G {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Created reservations ['b4c86595-3fb2-4f56-9e19-b8f21d37096e', '91c6b2f3-b77e-47d0-8653-0d1180ad0a62', '040639af-ff55-4dd9-b568-4640baa75165', '1a8e7b95-aef3-435f-a979-350506397e11'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:09 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 1G Apr 28 05:06:09 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:09 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:09 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:09 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:10 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:10 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Deleted volume successfully. Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-95acc20f-960c-42eb-9ee8-cc4c56a84be2 tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-71fe16f7-e5c8-4115-92ab-1a8184259a0d-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:10 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 1G" returned: 0 in 0.628s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:10 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 Apr 28 05:06:10 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-9bacbe45-df33-4b9b-b29e-66bc227e3181-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-9bacbe45-df33-4b9b-b29e-66bc227e3181-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e1e7c-427d-4088-b15e-61f2930a7068]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:10 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 Apr 28 05:06:10 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:10 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 -F qcow2 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" returned: 0 in 0.580s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:10 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 is being set with open permissions: ugo+rw Apr 28 05:06:10 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:10 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 Apr 28 05:06:10 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:11 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:11 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181" returned: 0 in 0.545s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" returned: 0 in 0.467s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:11 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181 Apr 28 05:06:11 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:11 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info Apr 28 05:06:11 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:11 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-9bacbe45-df33-4b9b-b29e-66bc227e3181" returned: 0 in 0.456s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-quobyte-9bacbe45-df33-4b9b-b29e-66bc227e3181" released by "delete_volume" :: held 1.050s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:11 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info" returned: 0 in 0.462s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:11 devstack cinder-volume[82097]: WARNING cinder.volume.drivers.remotefs [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info is being set with open permissions: ugo+rw Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:11 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info Apr 28 05:06:11 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Created reservations ['16e2db1c-fbbe-40a9-930a-baf0552fb166', '3c09f88d-dee2-4c0d-90d7-82e215738740', 'e9f7fcc7-0efd-4ff0-a629-c7ada5e93351', '0d14ada7-54bd-49fb-bf86-cea72dd1b054'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:11 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:11 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:11 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:12 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.info" returned: 0 in 0.437s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.203s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-fbf66238-810d-4fc4-8e8f-2eacaf3c6590 tempest-CinderUnicodeTest-1223689758 None] Create snapshot completed successfully Apr 28 05:06:12 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:12 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.458s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:12 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:12 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Deleted volume successfully. Apr 28 05:06:12 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-d7aeb90d-c79d-41c3-b1b5-9c8463cf93ce tempest-SnapshotDependencyTests-2028582814 None] Lock "cinder-9bacbe45-df33-4b9b-b29e-66bc227e3181-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0-delete_snapshot" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" by "delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-quobyte-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" by "_delete_snapshot" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Deleting offline snapshot d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 of volume fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] snapshot_file for this snap is: volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fb5209-0d5c-4e92-9e98-0674001cdbaf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:13 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 Apr 28 05:06:13 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:13 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" returned: 0 in 0.595s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.remotefs [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82097) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01987fec-9182-45fb-8174-5b3ec0c1c030]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:13 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:13 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 Apr 28 05:06:13 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:14 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1" returned: 0 in 0.582s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:14 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 Apr 28 05:06:14 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:14 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" returned: 0 in 0.603s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:14 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:14 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0 Apr 28 05:06:14 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:15 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:15 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1.d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" returned: 0 in 0.487s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0" released by "_delete_snapshot" :: held 2.373s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" released by "delete_snapshot" :: held 2.399s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:15 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Created reservations ['98812f20-9ca6-4db5-b8a2-58a51c35489d', 'a9bb4e9f-2219-487c-905f-2848a8b62bfa', 'e2f913da-acec-4cc9-b959-de51bac224a8', 'fa2b8619-ed99-4f89-9c80-e9488c39c29a'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:15 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Delete snapshot completed successfully. Apr 28 05:06:15 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-62be6329-57e0-41fe-b1ad-1467687c8828 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-d7be00ed-241c-4feb-a18d-51c9d2c5e9e0-delete_snapshot" released by "delete_snapshot" :: held 2.604s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-fcebb16e-2aac-4acd-8729-e63cb103f4b1-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-fcebb16e-2aac-4acd-8729-e63cb103f4b1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" acquired by "delete_volume" :: waited 0.015s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc6c72-1224-4da4-9589-8621419cd12d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:16 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 Apr 28 05:06:16 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:16 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1" returned: 0 in 0.606s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:16 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:17 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1 Apr 28 05:06:17 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:17 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-fcebb16e-2aac-4acd-8729-e63cb103f4b1" returned: 0 in 0.485s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-fcebb16e-2aac-4acd-8729-e63cb103f4b1" released by "delete_volume" :: held 1.159s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Created reservations ['ef0d7c6b-46c6-4f52-a1f1-ccce7f13e1f6', 'a7ab2f4c-309b-4322-b63a-17ee92de81e2', '51dea7a4-82b1-4782-9f2c-6402f620aef5', '2ec7c6c1-3fe4-40d4-8165-d0e360c97226'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:17 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:17 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:17 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:18 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.450s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:18 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Deleted volume successfully. Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-a360a4e9-4e71-44c7-b4f0-4f355426b85a tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-fcebb16e-2aac-4acd-8729-e63cb103f4b1-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-f3bcd488-10cd-45e8-a64f-51c7c5963258-delete_volume" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-f3bcd488-10cd-45e8-a64f-51c7c5963258-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "cinder-quobyte-f3bcd488-10cd-45e8-a64f-51c7c5963258" by "delete_volume" {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-f3bcd488-10cd-45e8-a64f-51c7c5963258" acquired by "delete_volume" :: waited 0.022s {{(pid=82097) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe239d6-6da9-4e3f-8d5e-b74b22b95d81]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:06:18 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:18 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 Apr 28 05:06:18 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:19 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258" returned: 0 in 0.575s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:19 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258 Apr 28 05:06:19 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:19 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de/volume-f3bcd488-10cd-45e8-a64f-51c7c5963258" returned: 0 in 0.490s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-quobyte-f3bcd488-10cd-45e8-a64f-51c7c5963258" released by "delete_volume" :: held 1.108s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG cinder.quota [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Created reservations ['dab6e3ca-af23-4fc9-aa25-6eac0539818a', '6684ba8c-9193-476a-a696-9abd64e7d12e', 'df34ef89-6127-40dc-b1ec-8ccf2cbcf4cb', '83aa31ab-b598-4d64-9da0-75374049494d'] {{(pid=82097) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4': None} {{(pid=82097) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG cinder.volume.drivers.quobyte [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e061bc1a-9d50-4d00-ba18-0e96880d62d4'] {{(pid=82097) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.lockutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:06:19 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:06:19 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de Apr 28 05:06:19 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:06:20 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Apr 28 05:06:20 devstack cinder-volume[82097]: DEBUG oslo_concurrency.processutils [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41d956db9afcf4cc676734326e8ab7de" returned: 0 in 0.484s {{(pid=82097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:06:20 devstack cinder-volume[82097]: DEBUG cinder.manager [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Notifying Schedulers of capabilities ... {{(pid=82097) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:06:20 devstack cinder-volume[82097]: INFO cinder.volume.manager [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Deleted volume successfully. Apr 28 05:06:20 devstack cinder-volume[82097]: DEBUG cinder.coordination [None req-b1bebf73-6df2-422a-b76f-1dd5d138f8a9 tempest-CinderUnicodeTest-1223689758 None] Lock "cinder-f3bcd488-10cd-45e8-a64f-51c7c5963258-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82097) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:06:29 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=50,cinder:INSERT=22,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:06:30 devstack cinder-volume[82097]: DEBUG dbcounter [-] [82097] Writing DB stats cinder:SELECT=112,cinder:INSERT=44,cinder:UPDATE=155,cinder:DELETE=9 {{(pid=82097) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}